main : add `--in-prefix-bos` to prefix BOS to user inputs; keep EOS (#2304)
* add `--in-prefix-bos` to prefix BOS to user inputs; keep EOS The BOS precedes the string specified by `--in-prefix`. Model generated EOS is now kept in the context. It provides a way to strictly following the prompt format used in Llama-2-chat. The EOS handling also benefits some existing finetunes that uses EOS to mark the end of turn. * examples/common: move input_prefix_bos to other bools
X
Xiao-Yong Jin committed
0c06204fb39aa5560e883e0ae74be9518c57d88e
Parent: 1fed755
Committed by GitHub <noreply@github.com>
on 7/25/2023, 12:19:11 PM