CVE-2024-8939CWE-400

Vllm: denials of service in vllm json web api

Medium · published September 17, 2024

CVSS v3.1
6.2
EPSS
0%
Percentile
13.4
In the wild
Unconfirmed
What it is

A vulnerability was found in the ilab model serve component, where improper handling of the best_of parameter in the vllm JSON web API can lead to a Denial of Service (DoS). The API used for LLM-based sentence or chat completion accepts a best_of parameter to return the best completion from several options. When this parameter is set to a large value, the API does not handle timeouts or resource exhaustion properly, allowing an attacker to cause a DoS by consuming excessive system resources. This leads to the API becoming unresponsive, preventing legitimate users from accessing the service.

The record
Technical detail
CVSS v3.1
6.2 · MEDIUM
Vector
CVSS:3.1/AV:L/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H
CVSS v4.0
Not supplied
EPSS
0.00233 · 13.4th percentile
Weakness
CWE-400 · Uncontrolled Resource Consumption
Published
2024-09-17T16:21Z
EPSS history
Timeline
  • 17 SEP 16:21Z
    Vllm: denials of service in vllm json web api
    cvelistv5