# Active vs Reserved GPU Memory

**URL:** https://discuss.vllm.ai/t/active-vs-reserved-gpu-memory/2186
**Category:** General
**Created:** [January 5, 2026, 1:55pm UTC](https://discuss.vllm.ai/t/active-vs-reserved-gpu-memory/2186 "2026-01-05T13:55:10Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![ydem](https://avatars.discourse-cdn.com/v4/letter/y/898d66/32.png) [@ydem](https://discuss.vllm.ai/u/ydem)
#### Post date: [January 5, 2026, 1:55pm UTC](https://discuss.vllm.ai/t/active-vs-reserved-gpu-memory/2186/1 "2026-01-05T13:55:10Z")

</div>

@RunLLM  
vLLM allocates a large KV-cache on startup based on `gpu_memory_utilization`, which makes `nvidia-smi` report very high GPU memory usage even when the server is idle. I understand that the reserved KV size can be derived from the cache configuration (e.g., `num_gpu_blocks × bytes_per_block`), but I’m trying to understand how to observe the actively used portion of that memory at runtime.

I looked through the general metrics at  
[https://docs.vllm.ai/en/latest/usage/metrics/#general-metrics](https://docs.vllm.ai/en/latest/usage/metrics/#general-metrics)  
and I can scrape those successfully, but I don’t see any metrics related to actively used percentage.

Thanks!

---

<div class="post-metadata">

### Author: ![RunLLM](https://yyz2.discourse-cdn.com/flex036/user_avatar/discuss.vllm.ai/runllm/32/233_2.png) [@RunLLM](https://discuss.vllm.ai/u/RunLLM)
#### Post date: [January 5, 2026, 1:55pm UTC](https://discuss.vllm.ai/t/active-vs-reserved-gpu-memory/2186/2 "2026-01-05T13:55:44Z")

</div>

vLLM exposes the actively used portion of the KV cache via the kv\_cache\_usage metric, which reports the percentage of allocated KV cache blocks currently in use. This metric is available as vllm:kv\_cache\_usage\_perc in Prometheus and is also logged periodically by the LoggingStatLogger. It reflects the fraction of the preallocated KV cache that is actively occupied by requests at runtime, not just the total reserved memory.

You can monitor this metric by scraping the /metrics endpoint if PrometheusStatLogger is enabled, or by checking the log output if LoggingStatLogger is active. For more details, see [Frontend Stats Collection](https://docs.vllm.ai/en/latest/design/metrics/#frontend-stats-collection) and [Metrics Publishing - Logging](https://docs.vllm.ai/en/latest/design/metrics/#metrics-publishing---logging). Would you like more detail on how to interpret or use this metric?

Sources:

- [Frontend Stats Collection](https://docs.vllm.ai/en/latest/design/metrics/#frontend-stats-collection)

Hint: Mention @RunLLM in the post for followups.
