SIGN IN SIGN UP

feat(nemotron_v3): run MTP heads under eval for validation acceptance metrics (#2802)

* feat(nemotron_v3): run MTP heads under eval for validation acceptance metrics

Add a `compute_mtp_in_eval` flag (default False) to NemotronHForCausalLM so the
MTP heads can run during validation to measure per-head token acceptance, while
keeping the cached generation/decoding path free of any MTP cost (gated on
`not use_cache`). The training harness toggles it around the validation forward
only.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: SlyneD <slyned@nvidia.com>

* test(nemotron_v3): cover MTP configuration and checkpoint views

Signed-off-by: SlyneD <slyned@nvidia.com>

---------

Signed-off-by: SlyneD <slyned@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
S
Slyne Deng committed
03c7e705353eea79577540b3db0360bf6707f567
Parent: 288769b
Committed by GitHub <noreply@github.com> on 8/11/2026, 3:04:00 AM