SIGN IN SIGN UP

A high-throughput and memory-efficient inference and serving engine for LLMs

0 0 122 Python

[V1][spec decode] return logprobs for spec decoding (#26060)

Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
G
Giancarlo Delfin committed
6644796bf445ad6fb34b25c6efe297ce8fe31f81
Parent: ff93cc8
Committed by GitHub <noreply@github.com> on 10/23/2025, 5:59:59 AM