ci: authenticate HuggingFace model prefetch to avoid rate limits (#1948)
## What? The shared CI egress was being rate-limited by HuggingFace on anonymous requests, causing the vLLM and SGLang sanity stages to fail during Qwen/Qwen3-8B prefetch. Bind the svc-nixl-hf-token Jenkins secret text credential as HF_TOKEN in the build-wheel pipeline and pass it through to the sanity testScript so snapshot_download authenticates rather than hitting the anonymous rate limit. ## Why? rate limit failing build-wheel pipeline on rare occasions ## How? _It is optional, but for complex PRs, please provide information about the design, architecture, approach, etc._ <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **Bug Fixes** * Improved vLLM and SGLang aarch64 CI sanity checks by routing model prefetch through an internal Hugging Face mirror endpoint when provided. * Increased prefetch reliability by extending Hugging Face metadata/download timeouts during the CI sanity prefetch flow. * **Documentation** * Updated the CI overview to clarify dispatcher-triggered sanity prefetch uses the internal mirror (not `huggingface.co`) and how the mirror endpoint is supplied to the SLURM sanity container. <!-- end of auto-generated comment: release notes by coderabbit.ai --> Signed-off-by: NirWolfer <nwolfer@nvidia.com>
N
NirWolfer committed
fca3d58989c5610427247e39087d30cb2d378b78
Parent: eeb9497
Committed by GitHub <noreply@github.com>
on 7/27/2026, 3:33:40 PM