[CI][Model] Stabilize MiniMax-M3-W8A8-A3 nightly validation (#15071)
## What this PR does Unblocks the MiniMax-M3-W8A8-A3 nightly workflow so that the accuracy benchmarks can run to completion. This PR: - switches the preliminary smoke test from the default completion endpoint to chat completion with `max_tokens: 10` and `thinking_mode: disabled`; - disables EAGLE3 speculative decoding; - disables the static kernel; - reduces `--max-num-seqs` from 64 to 16 so the 64-request benchmark is scheduled in stable waves; - keeps GPQA `max_out_len: 65536` so long reasoning responses can finish. The existing accuracy baselines and thresholds are intentionally unchanged. In particular, TextVQA remains at `baseline: 72` and `threshold: 2`, and GPQA remains at `baseline: 92` and `threshold: 2`. `enable_reduce_sample`, `FULL_DECODE_ONLY`, and the remaining W8A8 benchmark settings are also unchanged. The chat smoke arguments are not passed to AISBench, so GPQA continues to run with its configured reasoning behavior. ## Nightly failure analysis [Nightly-A3 run 33080082724](https://github.com/vllm-project/vllm-ascend/actions/runs/33080082724) checked out PR commit `30efb383da6b9d24bba0242dbbd9ae7279997258`. The service became healthy, but the default `/v1/completions` smoke request entered ACL graph replay and failed after the configured 60-second HCCL timeout: - `Communication_Error_Timeout(EI0002)`; - AIV `AllReduce_group_name_5` Notify wait timeout; - NPU error `507034`; - EngineCore exited and the request returned HTTP 500. No benchmark JSON was produced, so GPQA and TextVQA could not start. The new `test_content: chat_completion` entry replaces that blocking request path. ## Validation Validated on a 16-card A3 host with the nightly CI image and the W8A8 model: - service startup and `/health`: HTTP 200; - chat-completion requests, including the thinking-disabled smoke request: HTTP 200; - 64 concurrent short chat-completion requests with `max_num_seqs=16`: 64/64 HTTP 200; - `max_num_seqs=32` was rejected after a long-decode stress run reproduced an ACL graph/HCCL timeout and engine exit; - a 16K GPQA cap cannot meet the existing accuracy gate even if every unfinished sample is counted as correct; - a targeted 32K rerun recovered some long-output samples, but the complete 32K run remained truncated, so the original 64K output limit is retained. The final [Nightly-A3 run 33146862269](https://github.com/vllm-project/vllm-ascend/actions/runs/33146862269) confirmed that the workflow is no longer blocked: - smoke request passed; - GPQA completed all 198 samples with 89.90% accuracy; - TextVQA completed with 72.93% accuracy and passed its original threshold-2 gate. GPQA remains slightly below its existing 90% lower bound. That accuracy regression is present on the current main branch and is intentionally left for a separate follow-up; this PR only restores a runnable, non-blocking nightly path without weakening the accuracy gates. - vLLM main: https://github.com/vllm-project/vllm/commit/ba07e4a48fc951300d97eb506217dd530583dea3 --------- Signed-off-by: Ye Chenglin <1084697284@qq.com> Signed-off-by: Ye Chenglin <2023200642@mail.nwpu.edu.cn>
Y
Ye Chenglin committed
9cb118ee31dbb0ff5ed71b075579dc97c1c68e35
Parent: 0c4d84e
Committed by GitHub <noreply@github.com>
on 8/28/2026, 9:06:11 AM