Does vLLM support shieldgemma?

General
1

trying to run shieldgemma 2 but does give this error:

(APIServer pid=1) Value error, Model architectures [‘ShieldGemma2ForImageClassification’] are not supported for now. Supported architectures: dict_keys([‘AfmoeForCausalLM’, ‘ApertusForCausalLM’, ‘AquilaModel’, ‘AquilaForCausalLM’, ‘ArceeForCausalLM’, ‘ArcticForCausalLM’, ‘BaiChuanForCausalLM’, ‘BaichuanForCausalLM’, ‘BailingMoeForCausalLM’, ‘BailingMoeV2ForCausalLM’, ‘BambaForCausalLM’, ‘BloomForCausalLM’, ‘ChatGLMModel’, ‘ChatGLMForConditionalGeneration’, ‘CohereForCausalLM’, ‘Cohere2ForCausalLM’, ‘CwmForCausalLM’, ‘DbrxForCausalLM’, ‘DeciLMForCausalLM’, ‘DeepseekForCausalLM’, ‘DeepseekV2ForCausalLM’, ‘DeepseekV3ForCausalLM’, ‘DeepseekV32ForCausalLM’, ‘Dots1ForCausalLM’, ‘Ernie4_5ForCausalLM’, ‘Ernie4_5_MoeForCausalLM’, ‘ExaoneForCausalLM’, ‘Exaone4ForCausalLM’, ‘Fairseq2LlamaForCausalLM’, ‘FalconForCausalLM’, ‘FalconMambaForCausalLM’, ‘FalconH1ForCausalLM’, ‘FlexOlmoForCausalLM’, ‘GemmaForCausalLM’, ‘Gemma2ForCausalLM’, ‘Gemma3ForCausalLM’, ‘Gemma3nForCausalLM’, ‘Qwen3NextForCausalLM’, ‘GlmForCausalLM’, ‘Glm4ForCausalLM’, ‘Glm4MoeForCausalLM’, ‘GptOssForCausalLM’, ‘GPT2LMHeadModel’, ‘GPTBigCodeForCausalLM’, ‘GPTJForCausalLM’, ‘GPTNeoXForCausalLM’, ‘GraniteForCausalLM’, ‘GraniteMoeForCausalLM’, ‘GraniteMoeHybridForCausalLM’, ‘GraniteMoeSharedForCausalLM’, ‘GritLM’, ‘Grok1ModelForCausalLM’, ‘HunYuanMoEV1ForCausalLM’, ‘HunYuanDenseV1ForCausalLM’, ‘HCXVisionForCausalLM’, ‘InternLMForCausalLM’, ‘InternLM2ForCausalLM’, ‘InternLM2VEForCausalLM’, ‘InternLM3ForCausalLM’, ‘JAISLMHeadModel’, ‘JambaForCausalLM’, ‘KimiLinearForCausalLM’, ‘Lfm2ForCausalLM’, ‘Lfm2MoeForCausalLM’, ‘LlamaForCausalLM’, ‘Llama4ForCausalLM’, ‘LLaMAForCausalLM’, ‘LongcatFlashForCausalLM’, ‘MambaForCausalLM’, ‘Mamba2ForCausalLM’, ‘MiniCPMForCausalLM’, ‘MiniCPM3ForCausalLM’, ‘MiniMaxForCausalLM’, ‘MiniMaxText01ForCausalLM’, ‘MiniMaxM1ForCausalLM’, ‘MiniMaxM2ForCausalLM’, ‘MistralForCausalLM’, ‘MistralLarge3ForCausalLM’, ‘MixtralForCausalLM’, ‘MptForCausalLM’, ‘MPTForCausalLM’, ‘MiMoForCausalLM’, ‘NemotronForCausalLM’, ‘NemotronHForCausalLM’, ‘OlmoForCausalLM’, ‘Olmo2ForCausalLM’, ‘Olmo3ForCausalLM’, ‘OlmoeForCausalLM’, ‘OPTForCausalLM’, ‘OrionForCausalLM’, ‘OuroForCausalLM’, ‘PanguEmbeddedForCausalLM’, ‘PanguUltraMoEForCausalLM’, ‘PersimmonForCausalLM’, ‘PhiForCausalLM’, ‘Phi3ForCausalLM’, ‘PhiMoEForCausalLM’, ‘Plamo2ForCausalLM’, ‘Plamo3ForCausalLM’, ‘QWenLMHeadModel’, ‘Qwen2ForCausalLM’, ‘Qwen2MoeForCausalLM’, ‘Qwen3ForCausalLM’, ‘Qwen3MoeForCausalLM’, ‘RWForCausalLM’, ‘SeedOssForCausalLM’, ‘Step3TextForCausalLM’, ‘StableLMEpochForCausalLM’, ‘StableLmForCausalLM’, ‘Starcoder2ForCausalLM’, ‘SolarForCausalLM’, ‘TeleChatForCausalLM’, ‘TeleChat2ForCausalLM’, ‘TeleFLMForCausalLM’, ‘XverseForCausalLM’, ‘Zamba2ForCausalLM’, ‘BertModel’, ‘BertSpladeSparseEmbeddingModel’, ‘Gemma2Model’, ‘Gemma3TextModel’, ‘GPT2ForSequenceClassification’, ‘GteModel’, ‘GteNewModel’, ‘InternLM2ForRewardModel’, ‘JambaForSequenceClassification’, ‘LlamaModel’, ‘MistralModel’, ‘ModernBertModel’, ‘NomicBertModel’, ‘Qwen2Model’, ‘Qwen2ForRewardModel’, ‘Qwen2ForProcessRewardModel’, ‘RobertaForMaskedLM’, ‘RobertaModel’, ‘XLMRobertaModel’, ‘CLIPModel’, ‘LlavaNextForConditionalGeneration’, ‘Phi3VForCausalLM’, ‘Qwen2VLForConditionalGeneration’, ‘SiglipModel’, ‘PrithviGeoSpatialMAE’, ‘Terratorch’, ‘BertForSequenceClassification’, ‘BertForTokenClassification’, ‘GteNewForSequenceClassification’, ‘ModernBertForSequenceClassification’, ‘ModernBertForTokenClassification’, ‘RobertaForSequenceClassification’, ‘XLMRobertaForSequenceClassification’, ‘JinaVLForRanking’, ‘AriaForConditionalGeneration’, ‘AyaVisionForConditionalGeneration’, ‘BeeForConditionalGeneration’, ‘Blip2ForConditionalGeneration’, ‘ChameleonForConditionalGeneration’, ‘Cohere2VisionForConditionalGeneration’, ‘DeepseekVLV2ForCausalLM’, ‘DeepseekOCRForCausalLM’, ‘DotsOCRForCausalLM’, ‘Ernie4_5_VLMoeForConditionalGeneration’, ‘FuyuForCausalLM’, ‘Gemma3ForConditionalGeneration’, ‘Gemma3nForConditionalGeneration’, ‘GLM4VForCausalLM’, ‘Glm4vForConditionalGeneration’, ‘Glm4vMoeForConditionalGeneration’, ‘GraniteSpeechForConditionalGeneration’, ‘H2OVLChatModel’, ‘HunYuanVLForConditionalGeneration’, ‘InternVLChatModel’, ‘NemotronH_Nano_VL_V2’, ‘OpenCUAForConditionalGeneration’, ‘InternS1ForConditionalGeneration’, ‘InternVLForConditionalGeneration’, ‘Idefics3ForConditionalGeneration’, ‘SmolVLMForConditionalGeneration’, ‘KeyeForConditionalGeneration’, ‘KeyeVL1_5ForConditionalGeneration’, ‘RForConditionalGeneration’, ‘KimiVLForConditionalGeneration’, ‘LightOnOCRForConditionalGeneration’, ‘Llama_Nemotron_Nano_VL’, ‘Llama4ForConditionalGeneration’, ‘LlavaForConditionalGeneration’, ‘LlavaNextVideoForConditionalGeneration’, ‘LlavaOnevisionForConditionalGeneration’, ‘MantisForConditionalGeneration’, ‘MiDashengLMModel’, ‘MiniMaxVL01ForConditionalGeneration’, ‘MiniCPMO’, ‘MiniCPMV’, ‘Mistral3ForConditionalGeneration’, ‘MolmoForCausalLM’, ‘NVLM_D’, ‘Ovis’, ‘Ovis2_5’, ‘PaddleOCRVLForConditionalGeneration’, ‘PaliGemmaForConditionalGeneration’, ‘Phi4MMForCausalLM’, ‘PixtralForConditionalGeneration’, ‘QwenVLForConditionalGeneration’, ‘Qwen2_5_VLForConditionalGeneration’, ‘Qwen2AudioForConditionalGeneration’, ‘Qwen2_5OmniModel’, ‘Qwen2_5OmniForConditionalGeneration’, ‘Qwen3OmniMoeForConditionalGeneration’, ‘Qwen3VLForConditionalGeneration’, ‘Qwen3VLMoeForConditionalGeneration’, ‘SkyworkR1VChatModel’, ‘Step3VLForConditionalGeneration’, ‘TarsierForConditionalGeneration’, ‘Tarsier2ForConditionalGeneration’, ‘UltravoxModel’, ‘VoxtralForConditionalGeneration’, ‘WhisperForConditionalGeneration’, ‘MiMoMTPModel’, ‘EagleLlamaForCausalLM’, ‘EagleLlama4ForCausalLM’, ‘EagleMiniCPMForCausalLM’, ‘Eagle3LlamaForCausalLM’, ‘LlamaForCausalLMEagle3’, ‘Eagle3Qwen2_5vlForCausalLM’, ‘Eagle3Qwen3vlForCausalLM’, ‘EagleMistralLarge3ForCausalLM’, ‘EagleDeepSeekMTPModel’, ‘DeepSeekMTPModel’, ‘ErnieMTPModel’, ‘LongCatFlashMTPModel’, ‘Glm4MoeMTPModel’, ‘MedusaModel’, ‘OpenPanguMTPModel’, ‘Qwen3NextMTP’, ‘SmolLM3ForCausalLM’, ‘Emu3ForConditionalGeneration’, ‘TransformersForCausalLM’, ‘TransformersMoEForCausalLM’, ‘TransformersMultiModalForCausalLM’, ‘TransformersMultiModalMoEForCausalLM’, ‘TransformersEmbeddingModel’, ‘TransformersMoEEmbeddingModel’, ‘TransformersMultiModalEmbeddingModel’, ‘TransformersForSequenceClassification’, ‘TransformersMoEForSequenceClassification’, ‘TransformersMultiModalForSequenceClassification’]) [type=value_error, input_value=ArgsKwargs((), {‘model’: …rocessor_plugin’: None}), input_type=ArgsKwargs]
(APIServer pid=1) For further information visit Redirecting...

2

The error means vLLM does not support the architecture ‘ShieldGemma2ForImageClassification’. Only models listed in the supported architectures can be loaded; ‘ShieldGemma2ForImageClassification’ is not among them. You can see the full list of supported architectures in the error message and in the vLLM model registry documentation.

To resolve this, you must use a model whose architecture is supported by vLLM, or wait for official support for ‘ShieldGemma2ForImageClassification’. If you believe the model should be supported, you can try explicitly specifying the architecture using the hf_overrides option, but this will only work if the underlying implementation exists in vLLM. More details on model resolution are available here.

Would you like more detail on how to check or override model architectures?

Sources:

Hint: Mention @RunLLM in the post for followups.