vulkan: Optimize some mat-vec mul quant shaders (#10296)
Compute two result elements per workgroup (for Q{4,5}_{0,1}). This reuses
the B loads across the rows and also reuses some addressing calculations.
This required manually partially unrolling the loop, since the compiler
is less willing to unroll outer loops.
Add bounds-checking on the last iteration of the loop. I think this was at
least partly broken before.
Optimize the Q4_K shader to vectorize most loads and reduce the number of
bit twiddling instructions. J
Jeff Bolz committed
772703c8fffdd83d2e28f60119e83525f1189412
Parent: dd3a6ce
Committed by GitHub <noreply@github.com>
on 11/16/2024, 6:26:57 AM