Servers and applications
GHSA-qff2-492f-9fm4
Rust HTTP/gRPC stop_token_ids bypass Python vocab-bound fix and can terminate EngineCore
- Severity
- Medium 5.9
- Published
- 12 Sept 2026
- Last changed
- 27 Oct 2026
- Added to UpHeron
- 3 Nov 2026
- Fixed in
- 0.24.0
- Attack
- Over the network · Only under certain conditions · No login needed · No user action needed
- Attacker can
- Take it down
- CVSS vector
CVSS:3.1/AV:N/AC:H/PR:N/UI:N/S:U/C:N/I:N/A:H- Sources
- Project advisories (GitHub)
Description
Public PR #44968 fixes a vLLM denial-of-service condition where user-supplied stop_token_ids outside [0, vocab_size) can reach MinTokensLogitsProcessor when min_tokens > 0, get used as CUDA tensor indices in logits.index_put_, trigger a device-side assertion, and leave EngineCore in a fatal state requiring restart.
That PR currently changes only the Python request path. Current Rust HTTP and Rust gRPC frontends expose the same stop_token_ids control, validate nearby token-id fields such as prompt, allowed_token_ids, and logit_bias, but do not vocab-bound stop_token_ids. The Rust paths forward those IDs into EngineCoreSamplingParams.all_stop_token_ids, which is the set consumed by the same Python min-tokens logits processor.
This is a sibling-callsite/incomplete-fix variant: after the Python-side fix, Rust OpenAI-compatible HTTP and Rust gRPC callers can still submit an out-of-vocabulary stop token with min_tokens > 0 and reach the fatal CUDA indexing sink.
Affected software
| Software | Affected versions |
|---|---|
vLLMServers and applications · github:vllm-project/vllm |
|
About vLLM
open-source software for large language model inference
- Docker Hub pulls
- 44,195,225Docker Hub, 15 Nov 2026
- GitHub stars
- 96,943GitHub, 15 Nov 2026
- Forks
- 24,836GitHub, 15 Nov 2026
- Latest release
- v0.33.0rc3GitHub, 15 Nov 2026
- Released
- 2 Nov 2026GitHub
- License
- Apache Software License 2.0Wikidata
- First published on GitHub
- 9 Feb 2023GitHub
Website Source code Docker image
Vulnerabilities in vLLM
- In our list
- 169
- Published in the last 12 months
- 150
- Critical, last 12 months
- 6
- High, last 12 months
- 63
- Known exploited
- 0
- CVE-2026-130686vLLM 0.6.0 before 0.33.0 Resource Exhaustion via Multi-Image RequestsHigh 8.7 18 Nov 2026
- CVE-2026-130684vLLM before 0.33.0 Path Traversal via speculators_config verifier.name_or_pathMedium 5.3 18 Nov 2026
- CVE-2026-130685vLLM 0.28.0 before 0.33.0 Unauthenticated DoS via Out-of-Range Prompt Token IDHigh 8.7 18 Nov 2026
- GHSA-xgh8-qwjh-q853/v1/systemone bypasses the --trust-request-chat-template gateMedium 6.5 18 Nov 2026
- CVE-2026-129356vllm-project vllm Common Prefix single_type_kv_cache_manager.py race conditionLow 2.3 15 Nov 2026
- CVE-2026-126394vLLM 0.30.0 before 0.31.0 Resource Exhaustion via OpenPangu Video Backend num_framesMedium 6.9 13 Nov 2026
References
- GitHub Advisory Database https://github.com/advisories/GHSA-qff2-492f-9fm4
- github.com https://github.com/vllm-project/vllm/security/advisories/GHSA-qff2-492f-9fm4