0 0 0 C++

llama : require first token to be BOS (#1303)

* llama : require first token to be BOS

* scripts : add ppl-run-all.sh

* perplexity : add BOS for each chunk

* readme : update perplexity values after BOS fix

* perplexity : add clarifying comments

Georgi Gerganov committed 3y ago

f9a6364912fd0463fddfdbc9ef9f79fdc281570d

Parent: 95078cc

Committed by GitHub <noreply@github.com> on 5/8/2023, 2:41:54 PM