SIGN IN SIGN UP

A high-throughput and memory-efficient inference and serving engine for LLMs

0 0 122 Python

[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selection (fix DP slow startup time &c) (#26709)

Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
I
Ilya Markov committed
237cf6d32aa3ab68c9f8dc50a6c5a15e62c8a86e
Parent: faee3cc
Committed by GitHub <noreply@github.com> on 10/23/2025, 12:58:39 PM