server : fix speculative decoding with context shift (#10641)
* server : fix speculative decoding with context shift ggml-ci * server : take into account speculative limits ggml-ci * server : add tests
G
Georgi Gerganov committed
1da7b765692764a8b33b08da61cbee63812a7bd9
Parent: 59f4db1
Committed by GitHub <noreply@github.com>
on 12/4/2024, 8:38:20 PM