Dequant improvements rebase (#8255)
* Single load for half2 * Store scales in local mem * Vec load quantized values
A
AidanBeltonS committed
fadde6713506d9e6c124f5680ab8c7abebe31837
Parent: a27152b
Committed by GitHub <noreply@github.com>
on 7/3/2024, 1:55:34 AM