SIGN IN SIGN UP

ggml : full ALiBi support (#7192)

* ggml : full ALiBi support

* ggml : update ggml_soft_max_ext() CUDA, SYCL

* ggml : ggml_flash_attn_ext() support ALiBi (CPU)

* ggml : ggml_flash_attn_ext() support ALiBi (Metal)

* ggml : fix warning

* ggml : ggml_flash_attn_ext() support ALiBi (CUDA)

ggml-ci

* ggml : fix assert message

* vulkan : add dev notes

* ggml : require mask when using ALiBi

ggml-ci

* convert : fix convert for refact models
G
Georgi Gerganov committed
9cb317f77e53067f7a138cc89ef7657148eae8e6
Parent: e849648
Committed by GitHub <noreply@github.com> on 5/11/2024, 7:32:41 AM