Retire the ggml_mul_mat() branch for transposed src0 (#500)
* Retire the ggml_mul_mat() for transposed src0 - It can always be made contiguous with ggml_cpy() - The code is now simplified - The results are deterministic in respect to num threads * SIMD-ify dequantize_row_q4_0() for ARM_NEON (#502) * Attempt to SIMD-ify dequantize_row_q4_0() for ARM_NEON * Fix dequantization - forgot to interleave the quants
G
Georgi Gerganov committed
ecbe466a364876927994e2f1ec14f4d82301d201
Parent: 502a400
Committed by GitHub <noreply@github.com>
on 3/25/2023, 5:47:21 PM