|
NCCL communication handing
|
|
1
|
20
|
January 24, 2026
|
|
在V100显卡上，vLLM并发问题
|
|
7
|
237
|
January 23, 2026
|
|
多机多卡推理 ray vllm遇到的报错
|
|
1
|
33
|
January 23, 2026
|
|
OpenAI Embeddings Not Working
|
|
2
|
61
|
January 22, 2026
|
|
GLM-4.7-Flash with nvidia
|
|
9
|
1218
|
January 22, 2026
|
|
怎么理解custom_all_reduce stage2的跨设备内存可见性注释
|
|
6
|
104
|
January 22, 2026
|
|
vLLM Tensor Parallel Workers Not Completing Initialization
|
|
3
|
246
|
January 21, 2026
|
|
Max_tokens_per_doc support for rerank models
|
|
1
|
17
|
January 21, 2026
|
|
一个长输入的请求，切chunk ，比如切了4份，prefill的时候，这四个可以同时做prefill 吗 ，还是有依赖关系的
|
|
15
|
55
|
January 21, 2026
|
|
Persistent segfaults/SIGSEGV
|
|
1
|
22
|
January 20, 2026
|
|
Why is it so slow to build a odeVLLM from source using Docker?
|
|
39
|
76
|
January 17, 2026
|
|
HarmonyError: Unexpected token 200002 while expecting start token 200006
|
|
1
|
132
|
January 14, 2026
|
|
Issue: Unable to pass precomputed image embeddings to vLLM
|
|
12
|
100
|
January 14, 2026
|
|
Clarify VLLM Wheels: What Does the +cu129 Tag Actually Change in v0.11.x?
|
|
1
|
31
|
January 13, 2026
|
|
Why Does Latency Remain Unchanged in vLLM 0.11.0 When Input Token Count Decreases for qwen3-vl-30b-a3b?
|
|
1
|
18
|
January 13, 2026
|
|
Why doesn't the parameter n in samplingparams work as expected
|
|
4
|
207
|
January 13, 2026
|
|
vLLM Engine Arguments Documentation
|
|
1
|
28
|
January 12, 2026
|
|
vLLM running on NVIDIA NIM vs Native VLLM tunning options
|
|
1
|
96
|
January 10, 2026
|
|
Pp8并行，update_from_output 会等所有rank的 model_executor.execute_model 执行完了之后才会执行吗
|
|
84
|
216
|
January 8, 2026
|
|
图片放在text后面导致精度下降问题
|
|
5
|
30
|
January 7, 2026
|
|
什么情况下，一个请求会被重复schedule?
|
|
58
|
95
|
January 6, 2026
|
|
How to set different attention backend for prefill and decode stage?
|
|
2
|
99
|
January 6, 2026
|
|
Active vs Reserved GPU Memory
|
|
1
|
21
|
January 5, 2026
|
|
Sampler.hip:564:63: error: local memory (66032) exceeds limit (65536) in 'void vllm::topKPerRowDecode<1024, true, false, true>'
|
|
1
|
18
|
January 5, 2026
|
|
Vllm0.11.0适配的llmcompressor 版本是什么
|
|
1
|
23
|
January 5, 2026
|
|
Question about full cudagraph of FlashAttention-v2
|
|
13
|
48
|
January 5, 2026
|
|
RTX 5090 + GLM incompatible issues - Please update
|
|
2
|
272
|
January 4, 2026
|
|
Vllm推理指标如何做可视化？
|
|
1
|
47
|
January 4, 2026
|
|
如何尽可能提升推理服务的吞吐量
|
|
3
|
156
|
January 4, 2026
|
|
Which software components vLLM inference needs
|
|
3
|
95
|
December 30, 2025
|