hybrid: reuse expert prefetch staging across prompts
Bind MUL_MAT_ID copies to persistent GPU slots so follow-up prefill does not cudaMalloc 210 MiB after gallocr shrink. Optional mmap host pin and froggeric Qwen chat template. Assisted-by: Grok
A
andi committed
2cf3a75dddd6d7b2457525fde030fe108f6e9063
Parent: 4bf36d8