All vulnerabilities

Servers and applications

GHSA-qff2-492f-9fm4

Rust HTTP/gRPC stop_token_ids bypass Python vocab-bound fix and can terminate EngineCore

Severity
Medium 5.9
Published
12 Sept 2026
Last changed
27 Oct 2026
Added to UpHeron
3 Nov 2026
Fixed in
0.24.0
Weakness
Improper input validation (CWE-20)CWE-129Uncontrolled resource consumption (CWE-400)
Attack
Over the network · Only under certain conditions · No login needed · No user action needed
Attacker can
Take it down
CVSS vector
CVSS:3.1/AV:N/AC:H/PR:N/UI:N/S:U/C:N/I:N/A:H
Sources
Project advisories (GitHub)

Description

Public PR #44968 fixes a vLLM denial-of-service condition where user-supplied stop_token_ids outside [0, vocab_size) can reach MinTokensLogitsProcessor when min_tokens > 0, get used as CUDA tensor indices in logits.index_put_, trigger a device-side assertion, and leave EngineCore in a fatal state requiring restart.

That PR currently changes only the Python request path. Current Rust HTTP and Rust gRPC frontends expose the same stop_token_ids control, validate nearby token-id fields such as prompt, allowed_token_ids, and logit_bias, but do not vocab-bound stop_token_ids. The Rust paths forward those IDs into EngineCoreSamplingParams.all_stop_token_ids, which is the set consumed by the same Python min-tokens logits processor.

This is a sibling-callsite/incomplete-fix variant: after the Python-side fix, Rust OpenAI-compatible HTTP and Rust gRPC callers can still submit an out-of-vocabulary stop token with min_tokens > 0 and reach the fatal CUDA indexing sink.

From vllm-project/vllm's security advisory. Shortened; the full text is there.

Affected software

SoftwareAffected versions
vLLMServers and applications · github:vllm-project/vllm
  • From 0.22.0 before 0.24.0

About vLLM

open-source software for large language model inference

From Wikidata, CC0 1.0.
Docker Hub pulls
44,195,225Docker Hub, 15 Nov 2026
GitHub stars
96,943GitHub, 15 Nov 2026
Forks
24,836GitHub, 15 Nov 2026
Latest release
v0.33.0rc3GitHub, 15 Nov 2026
Released
2 Nov 2026GitHub
License
Apache Software License 2.0Wikidata
First published on GitHub
9 Feb 2023GitHub

References