Llm.llm_engine.model_executor.driver_worker.model_runner.model.forward

[kakascode]

[rank0]: AttributeError: ‘LLMEngine’ object has no attribute ‘get_vllm_config’. Did you mean: ‘from_vllm_config’?

[RunLLM]

The error “‘LLMEngine’ object has no attribute ‘get_vllm_config’” means you are calling get_vllm_config on an LLMEngine instance, but this method is not available on the class you are using. In vLLM V1, get_vllm_config is present as a method of LLMEngine, but in V0, it is not. Make sure you are using the correct engine version and API. If you need to access the vllm_config, you can use the vllm_config attribute directly (e.g., llm_engine.vllm_config) in V1, or use the appropriate getter if available in your version. See LLMEngine V1 API for details.

Would you like more detail or a code example?

Sources:

• https://docs.vllm.ai/en/latest/api/vllm/v1/engine/llm_engine.html#vllm.v1.engine.llm_engine.LLMEngine.from_vllm_config
• https://docs.vllm.ai/en/latest/api/vllm/engine/llm_engine.html#__code_4