Does VLLM support BERT model?
@sengxin
Yes, vLLM support BERT model. You can find the list of supported models in the vLLM Documentation webpage
Supported Models — vLLM
ValueError: Model architectures [‘BertForSequenceClassification’] failed to be inspected. Please check the logs for more details. report errors