SIGN IN SIGN UP

Add DSpark drafter for Gemma 4 (#2137)

Backbone variant of the model-agnostic dspark drafter: reuses the shared
block sampling, confidence head and dflash round loop, and swaps in Gemma 4
draft layers (global_head_dim RoPE, attention_k_eq_v, sandwich norms,
layer_scalar).

Adds a _project_kv hook on DFlashAttention so a checkpoint that shares one
projection for keys and values does not need a forked attention block.
A
Alazer Manakelew committed
4dd264cadde06b325b76243b58ac47c9fe0fe597
Parent: 4ce5828
Committed by GitHub <noreply@github.com> on 9/1/2026, 11:52:08 PM