SIGN IN SIGN UP

A high-throughput and memory-efficient inference and serving engine for LLMs

0 0 122 Python

[small][batch invariance] Rename the env and internal flags to simplify usage (#26855)

Signed-off-by: Bram Wasti <bwasti@meta.com>
B
Bram Wasti committed
b2f78cbad4e86c484a0fcc518c9e8e3cded0e2cd
Parent: 23583ee
Committed by GitHub <noreply@github.com> on 10/16/2025, 9:40:25 PM