Vulnerability Information
Although we use advanced large model technology, its output may still contain inaccurate or outdated information.Shenlong tries to ensure data accuracy, but please verify and judge based on the actual situation.
Vulnerability Title
vLLM GGUF Kernels: int64_t to int truncation of tensor dimensions causes GPU buffer overflow
Vulnerability Description
vLLM is an inference and serving engine for large language models (LLMs). From 0.5.5 until 0.23.1rc0, integer truncation of tensor dimensions in vLLM's GGUF dequantize kernels (csrc/quantization/gguf/gguf_kernel.cu) causes partial tensor processing. The output tensor is allocated at full size via torch::empty (uninitialized memory), but the dequantize CUDA kernel processes only a truncated number of elements. The unfilled portion of the output tensor retains whatever was previously in GPU memory. In multi-tenant inference deployments, this residual GPU memory may contain tensor data from other users' inference requests, constituting information disclosure. This vulnerability is fixed in 0.23.1rc0.
CVSS Information
CVSS:4.0/AV:N/AC:L/AT:N/PR:N/UI:P/VC:L/VI:L/VA:N/SC:N/SI:N/SA:N
Vulnerability Type
数值类型间的不正确转换
Vulnerability Title
vLLM 信息泄露漏洞
Vulnerability Description
vLLM是vLLM团队开源的一个适用于 LLM 的高吞吐量和内存高效推理和服务引擎。 vLLM 0.5.5版本至0.23.1rc0之前版本存在安全漏洞,该漏洞源于GGUF反量化核中张量维度整数截断,导致输出张量部分处理,未填充部分保留先前GPU内存数据,在多租户推理部署中可能泄露其他用户推理请求的张量数据,造成信息泄露。
CVSS Information
N/A
Vulnerability Type
N/A