Features Quantization
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
|
About the Quantization category
|
|
0 | 15 | March 20, 2025 |
|
Support for Deploying 4-bit Fine-Tuned Model with LoRA on vLLM
|
|
13 | 170 | July 30, 2025 |
|
MoE quantization
|
|
9 | 693 | July 2, 2025 |
|
W8a8两种量化方式有详细介绍吗
|
|
1 | 80 | June 15, 2025 |
|
GGUF quantized models Inference support
|
|
0 | 174 | March 25, 2025 |