convert.py : BPE fixes (#2938)
* convert.py: BPE fixes? * Remove unnecessary conditional in addl token error handling
K
Kerfuffle committed
cff7b0bf07cb46e1ad4fd199f6bdeb538925c8c4
Parent: 340af42
Committed by GitHub <noreply@github.com>
on 9/3/2023, 5:52:13 AM