SIGN IN SIGN UP

fix(speculative): detect native MTP drafters via num_nextn_predict_layers (#2120)

resolve_drafter_kind fell back to dflash for a native checkpoint whose model_type
isn't in the kind table (e.g. deepseek_v4), and the dflash prefill path then read
config.target_layer_ids and raised before emitting a token. Auto-detect mtp when
the config declares num_nextn_predict_layers > 0, sharing one _expected_drafter_kind
helper with validate_drafter_compatibility.
A
Alazer Manakelew committed
ef8191e70f4de4a244cf791e4cc205aab944c59f
Parent: 25c7e8a
Committed by GitHub <noreply@github.com> on 8/31/2026, 6:49:37 PM