SIGN IN SIGN UP

speculative : add grammar support (#2991)

* speculative : add grammar support

* grammars : add json_arr.gbnf

* grammar : add comments to new grammar file

* grammar : remove one nested level

* common : warm-up with 2 tokens - seems to work better

* speculative : print draft token pieces

* speculative : reuse grammar parser + better logs and comments

* speculative : avoid grammar_mem

* make : fix speculative build
G
Georgi Gerganov committed
921772104ba2219bfdc2b2980d05ebc0aa0c92a4
Parent: 2ba85c8
Committed by GitHub <noreply@github.com> on 9/5/2023, 5:46:17 AM