SIGN IN SIGN UP

Vulkan Bugfixes and Improvements (#7084)

* Modify mat mat mul shader for mul_mat_id, modify mat vec mul shaders for single call batch operation

* Further work towards MoE, disabled for now

* Disable MoE code (not ready yet), fix a number of bugs in shaders and Vulkan code

* Add softmax with f16 mask and pos buffer support

* Disable mul_mat_id shaders for now

* Fix flake8

* Fix validation errors caused by empty buffers on larger batch sizes
0
0cc4m committed
befddd0f15de6efb15d7e7f5b527dfb671f4196f
Parent: d46dbc7
Committed by GitHub <noreply@github.com> on 5/9/2024, 6:39:54 PM