SIGN IN SIGN UP

gemma2: add sliding window mask (#8227)

* gemma2: add sliding window mask

* fix data_swa uninitialized

* better naming

* add co-author

Co-authored-by: Arlo Phoenix <arlo-phoenix@users.noreply.github.com>

* replace list with single tensor

* update

* llama : minor styling

* convert : add sanity check for query_pre_attn_scalar

* fix small typo in README

---------

Co-authored-by: Arlo Phoenix <arlo-phoenix@users.noreply.github.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
X
Xuan Son Nguyen committed
49122a873f54615626d1b49a2a39013ed4be98d5
Parent: 0ddeff1
Committed by GitHub <noreply@github.com> on 7/1/2024, 4:48:34 PM