SIGN IN SIGN UP

[DeepSeekV2] Fix integration tests OOM: use device_map=auto instead of 8-bit quantization (#47991)

* [DeepSeekV2] Fix integration tests: use device_map=auto, remove 8-bit quantization

The model (DeepSeek-V2-Lite) exceeds A10G VRAM even with 8-bit quantization.
Switch to device_map="auto" (bfloat16, no quantization) which offloads excess
weights to CPU. Update expected logit values accordingly.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* [DeepSeekV2] Update expected values for device_map=auto bfloat16 loading

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* [DeepSeekV2] Fix curly apostrophe in batch_fa2 expected text, add tearDown cleanup

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* [DeepSeekV2] Round expected logit values to 4 decimal places

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Y
Yih-Dar committed
a61d5f9e4fc184cff66938ff6c521cc358b5e024
Parent: bd5df99
Committed by GitHub <noreply@github.com> on 8/15/2026, 7:59:27 PM