SIGN IN SIGN UP

convert : add Poro-34B-chat tokenizer support (#7713)

* support for Poro chat pre-tokenizer

* add support for Poro pre-tokenizer

* Update convert-hf-to-gguf-update.py

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* Change Poro-34B-chat to poro-chat

* Change Poro-34B-chat to poro-chat

* Update convert-hf-to-gguf-update.py

* Update llama.cpp

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
E
Elaine committed
41b9260f18eb7f325c952006ac46afc1d0d8ad2f
Parent: 172c825
Committed by GitHub <noreply@github.com> on 6/14/2024, 10:16:49 AM