All vulnerabilities

Servers and applications

CVE-2026-54234

vLLM is a high-throughput and memory-efficient inference and serving engine for LLMs. Prior to 0.24.0, a frontend-legal multi-request speculative decoding workload can cause the rejection sampler to produce a recovered token equal to the model vocabulary size boundary value, which is then converted to negative one when the engine selects the next live token for a request and is written back into…

Severity
High 7.5
Published
6 Jul 2026
Last changed
25 Oct 2026
Added to UpHeron
3 Nov 2026
Fixed in
0.24.0
Exploit chance
0.6% in the next 30 daysHigher than 50% of CVEs. EPSS by FIRST, 19 Nov 2026
Weakness
Improper input validation (CWE-20)CWE-1284
Attack
Over the network · No login needed · No user action needed
Attacker can
Take it down
CVSS vector
CVSS:3.1/AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H
Sources
NVD

Description

vLLM is a high-throughput and memory-efficient inference and serving engine for LLMs. Prior to 0.24.0, a frontend-legal multi-request speculative decoding workload can cause the rejection sampler to produce a recovered token equal to the model vocabulary size boundary value, which is then converted to negative one when the engine selects the next live token for a request and is written back into the drafter's input ids; that out-of-vocabulary value is later consumed by the model's embedding and attention path and crashes the engine worker with a GPU device-side assertion. The same triggering request sequence is reachable through the public gRPC Generate and Abort endpoints, so a remote client that can send generation requests can crash the shared engine worker, aborting concurrent requests and causing a service-wide denial of service for other clients of the deployment until the worker is restarted. This issue is fixed in version 0.24.0.

From NVD.

Affected software

SoftwareAffected versions
vLLMServers and applications · cpe:a:vllm:vllm
  • Every version before 0.24.0

About vLLM

open-source software for large language model inference

From Wikidata, CC0 1.0.
Docker Hub pulls
44,195,225Docker Hub, 15 Nov 2026
GitHub stars
96,943GitHub, 15 Nov 2026
Forks
24,836GitHub, 15 Nov 2026
Latest release
v0.33.0rc3GitHub, 15 Nov 2026
Released
2 Nov 2026GitHub
License
Apache Software License 2.0Wikidata
First published on GitHub
9 Feb 2023GitHub

References

  • NVD https://nvd.nist.gov/vuln/detail/CVE-2026-54234
  • CVE.org https://www.cve.org/CVERecord?id=CVE-2026-54234