[Router][Feat] loadaware routing: KV-cache-aware placement weighted by live load (#1035)
Signed-off-by: Eliad Bazak <bazakeliad@gmail.com>
B
bazakeliad committed
048c6b49a1aa4649d2a7fa80a2f7d18f9bc2b69f
Parent: 06fe200
Committed by GitHub <noreply@github.com>
on 8/10/2026, 10:12:27 PM