0 0 0 C++

Introduce C-style API (#370)

* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning

Georgi Gerganov committed 3y ago

f5a77a629bd0f37ae1696747633ab42a5530ec15

Parent: da0e9fe

Committed by GitHub <noreply@github.com> on 3/22/2023, 5:32:36 AM