# Standalone draft model spec decode support in v0.x and v1

**URL:** https://discuss.vllm.ai/t/standalone-draft-model-spec-decode-support-in-v0-x-and-v1/2241
**Category:** Speculative Decoding
**Created:** [January 20, 2026, 7:40am UTC](https://discuss.vllm.ai/t/standalone-draft-model-spec-decode-support-in-v0-x-and-v1/2241 "2026-01-20T07:40:56Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![luxisme](https://yyz2.discourse-cdn.com/flex036/user_avatar/discuss.vllm.ai/luxisme/32/1083_2.png) [@luxisme](https://discuss.vllm.ai/u/luxisme)
#### Post date: [January 20, 2026, 7:40am UTC](https://discuss.vllm.ai/t/standalone-draft-model-spec-decode-support-in-v0-x-and-v1/2241/1 "2026-01-20T07:40:56Z")

</div>

Standalone draft model is removed in v0.x releases (x\>10): [Speculative Decoding - vLLM](https://docs.vllm.ai/en/v0.14.0/features/spec_decode/#speculating-with-a-draft-model)

And v1 does not support this either.

Can I know why this is not supported anymore?

---

<div class="post-metadata">

### Author: ![RunLLM](https://yyz2.discourse-cdn.com/flex036/user_avatar/discuss.vllm.ai/runllm/32/233_2.png) [@RunLLM](https://discuss.vllm.ai/u/RunLLM)
#### Post date: [January 20, 2026, 7:41am UTC](https://discuss.vllm.ai/t/standalone-draft-model-spec-decode-support-in-v0-x-and-v1/2241/2 "2026-01-20T07:41:26Z")

</div>

Speculative decoding with a standalone draft model is not supported in vLLM v0.10.0 and later, nor in v1, because the feature was deprecated and removed as part of a major architectural rework. The vLLM team prioritized other speculative decoding methods (like ngram, medusa, eagle, and mtp) due to technical challenges in supporting multi-model KV cache management and architectural differences between draft and target models. There is no current support or timeline for reintroducing standalone draft model speculative decoding in v1; users are advised to use alternative methods for now. See the official documentation and related issues for details: [v0.14.0 spec decode docs](https://docs.vllm.ai/en/v0.14.0/features/spec_decode/#speculating-with-a-draft-model), [feature removal discussion](https://github.com/vllm-project/vllm/issues/26547), and [v1 user guide](https://docs.vllm.ai/en/stable/getting_started/v1_user_guide.html#logprobs).

Would you like more detail on the technical reasons or migration alternatives?

Sources:

- [feature removal discussion](https://github.com/vllm-project/vllm/issues/26547)
- [v1 user guide](https://docs.vllm.ai/en/stable/getting_started/v1_user_guide.html#logprobs)
- [v0.14.0 spec decode docs](https://docs.vllm.ai/en/v0.14.0/features/spec_decode/#speculating-with-a-draft-model)

Hint: Mention @RunLLM in the post for followups.

---

<div class="post-metadata">

### Author: ![tomasruizt](https://yyz2.discourse-cdn.com/flex036/user_avatar/discuss.vllm.ai/tomasruizt/32/739_2.png) [@tomasruizt](https://discuss.vllm.ai/u/tomasruizt)
#### Post date: [January 20, 2026, 8:31am UTC](https://discuss.vllm.ai/t/standalone-draft-model-spec-decode-support-in-v0-x-and-v1/2241/3 "2026-01-20T08:31:02Z")

</div>

@RunLLM is wrong.

Support for draft model was reintroduced to V1 this week in this PR: [https://github.com/vllm-project/vllm/pull/24322](https://github.com/vllm-project/vllm/pull/24322) (I’m the PR author).

You can use it from main now, and it should be part of a release soon (I’m not familiar with the release cycle).

---

<div class="post-metadata">

### Author: ![RunLLM](https://yyz2.discourse-cdn.com/flex036/user_avatar/discuss.vllm.ai/runllm/32/233_2.png) [@RunLLM](https://discuss.vllm.ai/u/RunLLM)
#### Post date: [January 20, 2026, 8:31am UTC](https://discuss.vllm.ai/t/standalone-draft-model-spec-decode-support-in-v0-x-and-v1/2241/4 "2026-01-20T08:31:22Z")

</div>

You are correct—support for speculative decoding with a standalone draft model was reintroduced to vLLM V1 via [PR #24322](https://github.com/vllm-project/vllm/pull/24322) and is now available on the main branch. This PR enables using a separate draft model for speculative decoding, with configuration and runtime support, and includes benchmarks and tests. It is not yet part of an official release, but can be used by installing vLLM from the latest main branch.

Would you like more detail on how to use this feature or its current limitations?

Sources:

- [PR #24322: feat: spec decode with draft models](https://github.com/vllm-project/vllm/pull/24322)

Hint: Mention @RunLLM in the post for followups.
