convert : add Poro-34B-chat tokenizer support (#7713)
* support for Poro chat pre-tokenizer * add support for Poro pre-tokenizer * Update convert-hf-to-gguf-update.py Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> * Change Poro-34B-chat to poro-chat * Change Poro-34B-chat to poro-chat * Update convert-hf-to-gguf-update.py * Update llama.cpp --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
E
Elaine committed
41b9260f18eb7f325c952006ac46afc1d0d8ad2f
Parent: 172c825
Committed by GitHub <noreply@github.com>
on 6/14/2024, 10:16:49 AM