|
How use profile file to optimize the vllm inference as a model?
|
|
1
|
78
|
August 13, 2026
|
|
vllm部署minimax模型
|
|
1
|
120
|
August 11, 2026
|
|
Proxima - vLLM plugin for StarKV (3-4x more kv cache blocks)
|
|
1
|
64
|
August 10, 2026
|
|
Float32 Qwen3.5 4B Load
|
|
2
|
99
|
August 5, 2026
|
|
Community plugin library
|
|
1
|
71
|
August 5, 2026
|
|
vLLM - 1 Click Deployment on Cloudron
|
|
1
|
57
|
July 30, 2026
|
|
As of July 2026, what are some general tips in improving the speed of guided decoding in vllm?
|
|
2
|
171
|
July 29, 2026
|
|
Vllm lmcache server - how to run
|
|
11
|
388
|
July 28, 2026
|
|
Why does increasing max-num-seqs cause a runtime CUDA OOM?
|
|
1
|
115
|
July 28, 2026
|
|
Vllm omni and krea2
|
|
19
|
338
|
July 27, 2026
|
|
Vllm omni and 2x 5090
|
|
9
|
225
|
July 26, 2026
|
|
Structural GPU waste in DeepSeek-R1 inference anyone else measuring this
|
|
1
|
39
|
July 23, 2026
|
|
Does vllm *need* a restart once in a while?
|
|
1
|
112
|
July 23, 2026
|
|
PR #49434: Fix Poolside reasoning token initialization
|
|
1
|
127
|
July 22, 2026
|
|
Network Backend Simulation for vLLM
|
|
0
|
127
|
July 21, 2026
|
|
Registering with Transformers Auto Classes for out-of-tree models
|
|
4
|
397
|
July 15, 2026
|
|
LLM-Scaler vs. vllm
|
|
1
|
344
|
July 11, 2026
|
|
How can I use vllm with cuda 12.9
|
|
3
|
709
|
July 10, 2026
|
|
Should request priority also influence KV cache retention?
|
|
1
|
123
|
July 9, 2026
|
|
Configuration for PD disaggregation
|
|
2
|
190
|
July 7, 2026
|
|
Running out of memory despite very low `--gpu-memory-utilization`
|
|
2
|
299
|
July 5, 2026
|
|
HIP failure: the operation cannot be performed in the present state
|
|
7
|
395
|
July 2, 2026
|
|
Is there a way to perform DeepSeek-V4-Flash inference using vLLM on CUDA 12.6 and 8×H800?
|
|
1
|
217
|
July 1, 2026
|
|
Should vLLM consider prefix caching when chunked prefill is enabled?
|
|
2
|
916
|
June 30, 2026
|
|
Trying to passtrough 2 7900 XTX to proxmox ubuntu VM
|
|
13
|
433
|
June 27, 2026
|
|
Vllm serve拉起服务，到最后报错了
|
|
1
|
104
|
June 27, 2026
|
|
Window10 wsl2下不能使用vLLM的睡眠模式吗
|
|
1
|
163
|
June 27, 2026
|
|
Speech To Text Guidance
|
|
1
|
112
|
June 26, 2026
|
|
What is the correct chat template when serving gemma4?
|
|
2
|
1372
|
June 25, 2026
|
|
Seeking Help: DeepSeek-V4-Flash Fails to Deploy on 8×4090 (48GB VRAM per Card)
|
|
1
|
810
|
June 25, 2026
|