SIGN IN SIGN UP

common : ensure llama_batch size does not exceed max size (#9668)

A crash was observed when the number of tokens added to a batch exceeds
llama_batch size. An assertion in llama_batch_add was added to protect
against llama_batch size overflow.
M
matiaslin committed
faac0bae265449fd988c57bf894018edc36fbe1e
Parent: f99d3f8
Committed by GitHub <noreply@github.com> on 9/29/2024, 12:25:00 PM