ggml : add ggml_row_size() (fixes llama out of space) (#4461)
* Fixes "Not enough space in the context's memory pool" encountered on certain models, which seems to be caused by some imprecision related to the automatic casting of floating point values * do not cast to size_t, instead just use doubles * ggml : add ggml_row_size(), deprecate ggml_type_sizef() * ggml : fix row size compute to avoid overflows * tests : fix sizey -> sizez --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
L
LostRuins committed
20a68a7030ee06e8eb7eb8e24ae4ac52dc17803f
Parent: 55e87c3
Committed by GitHub <noreply@github.com>
on 12/14/2023, 12:13:33 PM