0 0 0 C++

speculative : fix prompt tokenization in speculative example (#4025)

* Support special tokens and not adding BOS to prompt in speculative

* Adapt to new should_add_bos function

* Ensure tgt and dft have same add_bos setting

Branden Butler committed 2y ago

40a34fe8d034bd484efd79ccbb95059ca6308dcb

Parent: dae06c0

Committed by GitHub <noreply@github.com> on 11/20/2023, 9:50:04 AM