GPU

vLLM throughput tuning: configure these four flags, not a bigger GPU

vLLM throughput tuning starts with KV cache blocks, not a bigger GPU. The four flags that decide your tokens/sec, and the one that quietly backfires.