SIGN IN SIGN UP

A high-throughput and memory-efficient inference and serving engine for LLMs

0 0 122 Python

[Bugfix] Fix incorrect kv cache metrics in grafana.json (#27133)

Signed-off-by: Fangping Shi <fangping_shi@apple.com>
Co-authored-by: Fangping Shi <fangping_shi@apple.com>
F
fangpings committed
7e0941055fdf89bae93045683dd80542177f3241
Parent: 6738e4a
Committed by GitHub <noreply@github.com> on 10/23/2025, 3:58:36 AM