|
About the Benchmarking category
|
|
0
|
116
|
March 20, 2025
|
|
We’re reproducing a public InferenceX / SemiAnalysis-style agentic recipe for deepseek-ai/DeepSeek-V4-Pro-0813 on 8× B300
|
|
1
|
78
|
October 14, 2026
|
|
New KVcache reduction method
|
|
1
|
74
|
October 6, 2026
|
|
Chunked prefill vs. P/D disaggregation over TCP on single-GPU AWS instances (vLLM 0.30.0, NIXL/UCX)
|
|
1
|
98
|
October 5, 2026
|
|
Booting 14 current open models on vLLM v0.29/v0.30: what broke with the defaults
|
|
1
|
114
|
October 3, 2026
|
|
vLLM Optimizer — automated benchmark-driven configuration tuning for vLLM
|
|
1
|
170
|
September 18, 2026
|
|
A general auto-tuner for vLLM: Optuna, workload replay and SLO-aware optimization
|
|
0
|
120
|
September 8, 2026
|
|
Dual RTX 5090 TP=2: SHM vs patched BAR1 P2P/CUMEM — single-pass +2.7% mean point estimate
|
|
1
|
250
|
August 11, 2026
|
|
vLLM服务开启了MTP，则如何评估指定维度的真实吞吐
|
|
2
|
301
|
May 25, 2026
|
|
Far different performance between Qwen3-4B and Qwen3-Embedding-4B
|
|
0
|
569
|
April 17, 2026
|
|
On prefill-only, kv_cache_usage_perc reaches max 0.32?
|
|
1
|
165
|
February 3, 2026
|
|
Benchmark for flash_attention
|
|
4
|
447
|
January 22, 2026
|
|
How to get the log for benchmarking
|
|
17
|
1309
|
January 19, 2026
|
|
Transformers `do_sample=False` vs SamplingParms `temperature=0` gives different results
|
|
1
|
862
|
November 15, 2025
|
|
VLLM 0.10.1 benchmark do not free memory
|
|
13
|
465
|
November 10, 2025
|
|
Vllm bench serve not all requests are successful. whats the reason?
|
|
5
|
715
|
October 23, 2025
|
|
How can I disable the model forward pass to measure host-only (CPU) overhead?
|
|
5
|
195
|
October 21, 2025
|
|
Vllm bench serve Order of "generated_texts"
|
|
16
|
776
|
October 6, 2025
|
|
Logprobs output from vllm bench serve
|
|
6
|
545
|
September 27, 2025
|
|
Running vllm bench serve from CPU-only node
|
|
3
|
944
|
August 29, 2025
|
|
Num request running stays on 1
|
|
3
|
538
|
August 29, 2025
|
|
Mixedbread reranker on vLLM `/score`: scores differ vs local Mixedbread; small payload = same order/different scores, large payload = different order
|
|
1
|
151
|
August 15, 2025
|
|
Vllm bench serve + Bearer API key + HTTPS
|
|
1
|
1005
|
August 7, 2025
|
|
使用以下2种方式，获得的结果有很大差异
|
|
50
|
3897
|
July 25, 2025
|
|
High-Throughput kernel on single-node
|
|
1
|
332
|
June 23, 2025
|
|
VLLM Engine Metrics
|
|
20
|
1225
|
June 11, 2025
|
|
vLLM benchmark host with self-signed certificate
|
|
1
|
547
|
June 4, 2025
|
|
ShareGPT implementation
|
|
1
|
983
|
May 22, 2025
|