2-bit quantizations (#4897)
* imatrix: load * imatrix: WIP * imatrix: Add Q2_K quantization * imatrix: also guard against Q2_K_S quantization without importance matrix * imatrix: guard even more against low-bit quantization misuse --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
K
Kawrakow committed
147b17ac94a24d524e367cda26a9ff6245689f34
Parent: 807179e
Committed by GitHub <noreply@github.com>
on 1/14/2024, 7:45:56 AM