CVE-2026-44223CWE-131CWE-704

vLLM: extract_hidden_states speculative decoding crashes server on any request with penalty parameters

Medium · published May 12, 2026

CVSS v3.1
6.5
EPSS
0%
Percentile
35.8
In the wild
Unconfirmed
What it is

vLLM is an inference and serving engine for large language models (LLMs). From 0.18.0 to before 0.20.0, the extract_hidden_states speculative decoding proposer in vLLM returns a tensor with an incorrect shape after the first decode step, causing a RuntimeError that crashes the EngineCore process. The crash is triggered when any request in the batch uses sampling penalty parameters (repetition_penalty, frequency_penalty, or presence_penalty). A single request with a penalty parameter (e.g., "repetition_penalty": 1.1) is sufficient to crash the server. This vulnerability is fixed in 0.20.0.

The record
Technical detail
CVSS v3.1
6.5 · MEDIUM
Vector
CVSS:3.1/AV:N/AC:L/PR:L/UI:N/S:U/C:N/I:N/A:H
CVSS v4.0
Not supplied
EPSS
0.00426 · 35.8th percentile
Weaknesses
CWE-131 · Incorrect Calculation of Buffer Size; CWE-704 · Incorrect Type Conversion or Cast
Published
2026-05-12T19:58Z
EPSS history
Timeline
  • 12 MAY 19:58Z
    vLLM: extract_hidden_states speculative decoding crashes server on any request with penalty parameters
    cvelistv5