SIGN IN SIGN UP

test(pp): fail parity tests when neither run trained (#3701)

The parity check only compares the two runs against each other, so two equally
broken runs agree perfectly and pass. A qwen3_5_moe proxy hit exactly that: its
weights were silently left uninitialized, both legs reported zero gradients and
a loss stuck at ln(vocab_size), and the comparison called it a pass.

Fail instead when a run reports grad_norm of exactly 0, or when the baseline
loss never moves across steps that each saw a different batch.

Signed-off-by: Abhishree <abhishreetm@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
A
Abhishree Thittenamane committed
6c2df72d8eefa88b67660b6603fb3cbfbcf8b67f
Parent: 7a36b6f
Committed by GitHub <noreply@github.com> on 8/27/2026, 5:48:43 PM