I want know how to use data-parallel not for deployment, but for offline inference.
machine
4
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| How to enable the --data-parallel-size function for a single machine? | 3 | 177 | October 12, 2025 | |
| Some question abound Data Parallel examples | 7 | 537 | June 21, 2025 | |
| Running vLLM multi-node data parallel with SLURM | 1 | 1119 | August 12, 2025 | |
| Offline multi-node inference | 11 | 696 | May 19, 2025 | |
| "vllm serve" to use all GPU's of a single-node multi-use | 5 | 948 | August 1, 2025 |