SIGN IN SIGN UP

server: stop generation at `n_ctx_train` if `n_predict` is not set (#6638)

* server: cap n_predict if not set to n_ctx_train

* server: fix infinite loop

* server: infinite loop, move in process_token
server: infinite loop: set stop limit to true

* minor: spaces

* minor: spaces

* server: include prompt tokens in the EOS limit
P
Pierrick Hymbert committed
7f5ff558eed0f732af8f25c2ab0645610bdec80c
Parent: 9e4e077
Committed by GitHub <noreply@github.com> on 4/26/2024, 10:15:30 AM