metal : separate scale and mask from QKT in FA kernel (#9189)
* metal : separate scale and mask from QKT in FA kernel * metal : ne01 check no longer necessary * metal : keep data in local memory
G
Georgi Gerganov committed
06658ad7c37f440502de2b9486ce43c47b4ec710
Parent: fc18425
Committed by GitHub <noreply@github.com>
on 8/26/2024, 3:31:02 PM