Rust cannot catch foreign exceptions

General
1

after pulled new nightly version for rocm vllm docker and running gemma4

[aiter] import [module_aiter_core] under /usr/local/lib/python3.12/dist-packages/aiter/jit/module_aiter_core.so
fatal runtime error: Rust cannot catch foreign exceptions, aborting

2

The error “fatal runtime error: Rust cannot catch foreign exceptions, aborting” during [aiter] import [module_aiter_core] in the ROCm vLLM Docker for Gemma4 is not explicitly documented in the official vLLM or Gemma4 deployment guides. The official Gemma4 ROCm deployment instructions and ROCm installation guides do not mention this Rust-related error or provide troubleshooting steps for it.

This issue may be related to a mismatch or incompatibility in the aiter, PyTorch, or ROCm stack, but the provided data sources do not contain a direct solution or reference to this specific runtime error. Would you like more detail on possible troubleshooting steps based on related ROCm and aiter issues?

Sources:

Hint: Mention @RunLLM in the post for followups.