llama : allow quantizing k-quants to fall back when tensor size incompatible (#3747)
* Allow quantizing k-quants to fall back when tensor size incompatible * quantizing: Add warning when tensors were incompatible with k-quants Clean up k-quants state passing a bit
K
Kerfuffle committed
bd6d9e205982b34e0ba2c3b22bbf31a1ef1a1bb5
Parent: ee1a0ec
Committed by GitHub <noreply@github.com>
on 10/28/2023, 11:54:24 AM