I have 8 Atlas 300i, but the NPU is 310 instead of 310P or 310B. Do you currently support it and do you plan to support it in the future
vLLM does not currently support the Atlas 300i with 310 NPU. The mainline vLLM-Ascend adaptation is developed and tested on Atlas 300T A2 (Ascend 910B/A2) and does not support 310 or 310P due to operator and kernel limitations. There is no explicit plan or timeline for 310 support, but contributions are welcome if you wish to help add support for this device. For more details, see the discussion in the pull request and related issues: according to Add Ascend NPU backend, the 310 series has more restrictions and is not currently targeted.
Would you like more detail on the technical limitations or how to get involved in development?
Sources:
Hint: Mention @RunLLM in the post for followups.
you can follow Single Node (Atlas 300I Series) — vllm-ascend to use ascend with 310 card.
Currently, only v0.10.0rc1 works with some model on 310.
We’re working on 310 full support in 2025 Q4. Please wait more .Thanks.
1 Like
Thank you very much. Our studio bought 50 Atlas 300i in 2021, all of which are NPU 310, which can save a lot of costs for our studio