运行AsyncLLM.from_vllm_config(vllm_config)时报错:
RuntimeError: Engine core initialization failed. See root cause above. Failed core proc(s): {}
这两个错误是否有联系
是的,调用AsyncLLM.from_vllm_config(vllm_config)时报错“RuntimeError: Engine core initialization failed. See root cause above. Failed core proc(s): {}”是vLLM常见的底层引擎初始化失败错误,通常与多进程worker或依赖环境有关,且这两类报错有直接联系,都是同一类初始化失败的表现形式。据vllm官方文档和源码实现,该异常会在worker进程未能正确启动或初始化时抛出。
具体原因需结合上方“See root cause above”前面的详细日志定位,常见包括依赖库冲突、内存不足、模型文件缺失、配置不一致等。如需进一步排查建议开启详细日志并检查环境依赖、模型路径和参数设置。如需详细排查步骤请告知。
Sources:
- https://docs.vllm.ai/en/latest/api/vllm/v1/engine/core_client.html#__span-0-548
- https://github.com/vllm-project/vllm/blob/main/vllm/v1/engine/utils.py
Hint: Mention @RunLLM in the post for followups.