fix(num_devices): fix num_shard/num device auto compute when NVIDIA_VISIBLE_DEVICES == "all" or "void" (#3346)
* fix(num_devices): fix num_shard/num devices auto compute when NVIDIA_VISIBLE_DEVICES == "all" the computed num_shards was always 1 in this case, no matter what * fix(num_devices): make TGI shard auto compute compliant with nvidia-container-toolkit in cdi mode
O
oOraph committed
dfb3fbe78e0d1d69251bd33065591c61bafdfaa8
Parent: 3498847
Committed by GitHub <noreply@github.com>
on 12/18/2025, 3:58:43 PM