Add DSpark drafter for Gemma 4 (#2137)
Backbone variant of the model-agnostic dspark drafter: reuses the shared block sampling, confidence head and dflash round loop, and swaps in Gemma 4 draft layers (global_head_dim RoPE, attention_k_eq_v, sandwich norms, layer_scalar). Adds a _project_kv hook on DFlashAttention so a checkpoint that shares one projection for keys and values does not need a forked attention block.
A
Alazer Manakelew committed
4dd264cadde06b325b76243b58ac47c9fe0fe597
Parent: 4ce5828
Committed by GitHub <noreply@github.com>
on 9/1/2026, 11:52:08 PM