All vulnerabilities

Servers and applications

GHSA-v5gm-qgmv-gc6c

Out-of-range `stop_token_ids` with `min_tokens` can kill vLLM EngineCore

Severity
Medium 6.5
Published
12 Sept 2026
Last changed
12 Sept 2026
Added to UpHeron
3 Nov 2026
Fixed in
0.29.0
Weakness
CWE-129
Attack
Over the network · Needs a user account · No user action needed
Attacker can
Take it down
CVSS vector
CVSS:3.1/AV:N/AC:L/PR:L/UI:N/S:U/C:N/I:N/A:H
Sources
Project advisories (GitHub)

Description

vLLM accepts user-controlled stop_token_ids on the OpenAI-compatible /v1/completions and /v1/chat/completions APIs, but only validates that the values are integers. It does not validate that each token id is within the model vocabulary/logits range.

When min_tokens > 0, vLLM uses stop_token_ids as logits indices to suppress stop tokens until the minimum generation length is reached. An out-of-range token id reaches a CUDA indexing operation and triggers a device-side assert, causing EngineCore to enter a fatal state and the API server to fail.

An authenticated API user can send a single malformed completion request that causes denial of service:

  • The request returns 500 Internal Server Error.
  • EngineCore reports a fatal error.
  • Subsequent requests fail until the service is restarted.

The demonstrated impact is service-level DoS through a CUDA device-side assertion.

stop_token_ids is accepted as list[int], and SamplingParams checks only the type:

From vllm-project/vllm's security advisory. Shortened; the full text is there.

Affected software

SoftwareAffected versions
vLLMServers and applications · github:vllm-project/vllm
  • Every version before 0.29.0

About vLLM

open-source software for large language model inference

From Wikidata, CC0 1.0.
Docker Hub pulls
44,195,225Docker Hub, 15 Nov 2026
GitHub stars
96,943GitHub, 15 Nov 2026
Forks
24,836GitHub, 15 Nov 2026
Latest release
v0.33.0rc3GitHub, 15 Nov 2026
Released
2 Nov 2026GitHub
License
Apache Software License 2.0Wikidata
First published on GitHub
9 Feb 2023GitHub

References