SIGN IN SIGN UP

2-bit quantizations (#4897)

* imatrix: load

* imatrix: WIP

* imatrix: Add Q2_K quantization

* imatrix: also guard against Q2_K_S quantization without importance matrix

* imatrix: guard even more against low-bit quantization misuse

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
K
Kawrakow committed
147b17ac94a24d524e367cda26a9ff6245689f34
Parent: 807179e
Committed by GitHub <noreply@github.com> on 1/14/2024, 7:45:56 AM