hybrid: prefill cached follow-ups above 4*decode
Share the first-prompt 4*decode threshold so a 768-token chat leftover uses ubatch 2048 instead of decode 64. Tiny leftovers stay on decode graphs. Rewrite start-ling-tiny.sh onto the start1660 knob surface with ngram n=12 m=4 (disables 12-48 token verifies) and KVFlash 8192. Assisted-by: Grok
A
andi committed
a673f78eee9f560b0d81399c482c3d5066ac6151
Parent: 75dfc23