SIGN IN SIGN UP

[Feat][Router] Add per-model request latency histogram (#940)

vllm:request_latency_seconds with server/model/status labels. observed
once per request in finally, so http 4xx/5xx and exceptions both land
as status=error.

Refs #699.

Signed-off-by: Mikhail Basov <Michael.S.Sinclair@protonmail.com>
Co-authored-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com>
M
Michael Basov committed
67307bd23b159cf66bb157f3d1f33bbcdde4076a
Parent: 2211261
Committed by GitHub <noreply@github.com> on 5/6/2026, 10:54:56 PM