llama : add support for GritLM (#5959)
* add gritlm example * gritlm results match * tabs to spaces * comment out debug printing * rebase to new embed * gritlm embeddings are back babeee * add to gitignore * allow to toggle embedding mode * Clean-up GritLM sample code. * Fix types. * Flush stdout and output ending newline if streaming. * mostly style fixes; correct KQ_mask comment * add causal_attn flag to llama_cparams * gritml : minor * llama : minor --------- Co-authored-by: Douglas Hanley <thesecretaryofwar@gmail.com> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
D
DAN™ committed
bcebd7dbf62fd7b293d5ed089023e4e733269c71
Parent: 2960eae
Committed by GitHub <noreply@github.com>
on 3/10/2024, 3:56:30 PM