vllm-ascend(310p) 是否支持银河麒麟桌面版操作系统, 如果不开启eager mode, 就会提示下面这个报错, 但是如果开启eager mode, 吞吐 仅仅只有 5~6 tokens/s , 如果把 桌面版操作系统换成银河麒麟服务器版本, 不用开启eager的情况下,吞吐速度就会有成倍的提升
ant to get the accurate stacktrace, please set the environment variable ASCEND_LAUNCH_BLOCKING=1.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] Note: ASCEND_LAUNCH_BLOCKING=1 will force ops to run in synchronous mode, resulting in performance degradation. Please unset ASCEND_LAUNCH_BLOCKING in time after debugging.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] [ERROR] 2026-09-04-05:30:44 (PID:243, Device:1, RankID:-1) ERR00100 PTA call acl api failed.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] [PID: 243] 2026-09-04-05:28:07.503.485 Invalid_Argument(EH0012): aclrtAllocatorGetByStream failed. Parameter stream is invalid. Reason: The stream is not registered with any allocator.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] TraceBack (most recent call last):
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] Asynchronous copy task failed. Reason: The pageable memory copy task does not support graph capture.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] The argument is invalid. Reason: rtMemcpyAsync execution failed.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007]
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007]
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] During handling of the above exception, another exception occurred:
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007]
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] Traceback (most recent call last):
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] File "/vllm-workspace/vllm/vllm/v1/executor/multiproc_executor.py", line 999, in worker_busy_loop
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] output = func(*args, **kwargs)
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] ^^^^^^^^^^^^^^^^^^^^^
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/worker.py", line 778, in compile_or_warm_up_model
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] npugraph_memory_bytes = self.model_runner.capture_model()
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/model_runner_v1.py", line 5010, in capture_model
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] with _torch_cuda_wrapper(), _replace_gpu_model_runner_function_wrapper(parent_module_name):
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] ^^^^^^^^^^^^^^^^^^^^^
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] File "/usr/local/python3.12.13/lib/python3.12/contextlib.py", line 158, in __exit__
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] self.gen.throw(value)
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/model_runner_v1.py", line 5117, in _torch_cuda_wrapper
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] raise RuntimeError(f"NPUModelRunner init failed, error is {e}")
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] RuntimeError: NPUModelRunner init failed, error is NPUModelRunner failed, error is The Inner error is reported as above. The process exits for this inner error, and the current copy params are srclen=8, dstlen=8, kind=1.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] Since the operator is called asynchronously, the stacktrace may be inaccurate. If you want to get the accurate stacktrace, please set the environment variable ASCEND_LAUNCH_BLOCKING=1.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] Note: ASCEND_LAUNCH_BLOCKING=1 will force ops to run in synchronous mode, resulting in performance degradation. Please unset ASCEND_LAUNCH_BLOCKING in time after debugging.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] [ERROR] 2026-09-04-05:30:44 (PID:243, Device:1, RankID:-1) ERR00100 PTA call acl api failed.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] [PID: 243] 2026-09-04-05:28:07.503.485 Invalid_Argument(EH0012): aclrtAllocatorGetByStream failed. Parameter stream is invalid. Reason: The stream is not registered with any allocator.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] TraceBack (most recent call last):
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] Asynchronous copy task failed. Reason: The pageable memory copy task does not support graph capture.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007] The argument is invalid. Reason: rtMemcpyAsync execution failed.
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007]
(Worker_TP1 pid=243) ERROR 09-04 05:30:46 [multiproc_executor.py:1007]