SIGN IN SIGN UP

metal : separate scale and mask from QKT in FA kernel (#9189)

* metal : separate scale and mask from QKT in FA kernel

* metal : ne01 check no longer necessary

* metal : keep data in local memory
G
Georgi Gerganov committed
06658ad7c37f440502de2b9486ce43c47b4ec710
Parent: fc18425
Committed by GitHub <noreply@github.com> on 8/26/2024, 3:31:02 PM