SIGN IN SIGN UP

metal : optimize FA kernels (#10171)

* ggml : add ggml_flash_attn_ext_get_prec

* metal : use F16 precision in FA kernels

ggml-ci

* metal : minor clean-up

* metal : compile-guard bf16 FA kernels

ggml-ci

* build : remove obsolete compile flag [no ci]

* metal : prevent int overflows [no ci]

* cuda : disable BF16 FA

ggml-ci

* metal : fix BF16 requirement for FA kernels

ggml-ci

* make : clean-up [no ci]
G
Georgi Gerganov committed
841f27abdbbcecc9daac14dc540ba6202e4ffe40
Parent: d05b312
Committed by GitHub <noreply@github.com> on 11/8/2024, 11:47:22 AM