Vulkan Bugfixes and Improvements (#7084)
* Modify mat mat mul shader for mul_mat_id, modify mat vec mul shaders for single call batch operation * Further work towards MoE, disabled for now * Disable MoE code (not ready yet), fix a number of bugs in shaders and Vulkan code * Add softmax with f16 mask and pos buffer support * Disable mul_mat_id shaders for now * Fix flake8 * Fix validation errors caused by empty buffers on larger batch sizes
0
0cc4m committed
befddd0f15de6efb15d7e7f5b527dfb671f4196f
Parent: d46dbc7
Committed by GitHub <noreply@github.com>
on 5/9/2024, 6:39:54 PM