SIGN IN SIGN UP

hybrid: reuse expert prefetch staging across prompts

Bind MUL_MAT_ID copies to persistent GPU slots so follow-up prefill
does not cudaMalloc 210 MiB after gallocr shrink. Optional mmap host
pin and froggeric Qwen chat template.

Assisted-by: Grok
A
andi committed
2cf3a75dddd6d7b2457525fde030fe108f6e9063
Parent: 4bf36d8