gguf-split: split and merge gguf per batch of tensors (#6135)
* gguf-split: split and merge gguf files per tensor * gguf-split: build with make toolchain * gguf-split: rename `--split-tensors-size` to `--split-max-tensors`. Set general.split_count KV to all split * split : minor style + fix compile warnings * gguf-split: remove --upload not implemented --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
P
Pierrick Hymbert committed
d0d5de42e5a65865b5fddb6f5c785083539b74c3
Parent: b80cf3b
Committed by GitHub <noreply@github.com>
on 3/19/2024, 11:05:44 AM