SIGN IN SIGN UP

main : add `--in-prefix-bos` to prefix BOS to user inputs; keep EOS (#2304)

* add `--in-prefix-bos` to prefix BOS to user inputs; keep EOS

The BOS precedes the string specified by `--in-prefix`.
Model generated EOS is now kept in the context.

It provides a way to strictly following the prompt format used in
Llama-2-chat.

The EOS handling also benefits some existing finetunes that uses
EOS to mark the end of turn.

* examples/common: move input_prefix_bos to other bools
X
Xiao-Yong Jin committed
0c06204fb39aa5560e883e0ae74be9518c57d88e
Parent: 1fed755
Committed by GitHub <noreply@github.com> on 7/25/2023, 12:19:11 PM