提个问题 vllm如何跑 embadding 用正常跑模型的参数貌似无法跑embadding模型求大佬解答 A question: How to run embadding with vllm? I can’t seem to run an embadding model with the normal model parameters, so I’m looking for an answer.

这个没有看明白用途，有使用案例可以参考么！！

better to use english in this forum.

Didn’t see the use for this one, is there a use case to look at!

It is possible to calculate similarity based on the hidden state embedding for recall.

[image] dugutianxue: Didn’t see the use for this one, is there a use case to look at! You can follow the example at vllm/examples/offline_inference/basic/embed.py at main · vllm-project/vllm · GitHub

It is possible to calculate similarity based on the hidden state embedding for recall. vLLM supports LLM.score, please check out this example: vllm/examples/offline_inference/basic/score.py at main · vllm-project/vllm · GitHub Our OpenAI-compatible server also has a Score API that does the same …

How to start embedding models

General

youkaichao March 20, 2025, 5:39am 2

you can check Pooling Models — vLLM

Topic		Replies	Views
Prompt_embeds usage in vllm openai completion api Multi-modality	4	199	June 17, 2025
Does the vLLM embedding model support inputting input_ids General	21	288	September 2, 2025
OpenAI Embeddings Not Working General	2	169	January 22, 2026
How to use prompt (prompt and prompt_name) for EmbeddingGemma using vllm General	1	88	February 4, 2026
How does vllm process multimodal embedding requests General	8	74	May 7, 2026

How to start embedding models

Related topics