llama : remove all_pos_0, all_pos_1, all_seq_id from llama_batch (#9745)
* refactor llama_batch_get_one * adapt all examples * fix simple.cpp * fix llama_bench * fix * fix context shifting * free batch before return * use common_batch_add, reuse llama_batch in loop * null terminated seq_id list * fix save-load-state example * fix perplexity * correct token pos in llama_batch_allocr
X
Xuan Son Nguyen committed
cda0e4b648dde8fac162b3430b14a99597d3d74f
Parent: afd9909
Committed by GitHub <noreply@github.com>
on 10/18/2024, 9:18:01 PM