speculative : add grammar support (#2991)
* speculative : add grammar support * grammars : add json_arr.gbnf * grammar : add comments to new grammar file * grammar : remove one nested level * common : warm-up with 2 tokens - seems to work better * speculative : print draft token pieces * speculative : reuse grammar parser + better logs and comments * speculative : avoid grammar_mem * make : fix speculative build
G
Georgi Gerganov committed
921772104ba2219bfdc2b2980d05ebc0aa0c92a4
Parent: 2ba85c8
Committed by GitHub <noreply@github.com>
on 9/5/2023, 5:46:17 AM