server: stop generation at `n_ctx_train` if `n_predict` is not set (#6638)
* server: cap n_predict if not set to n_ctx_train * server: fix infinite loop * server: infinite loop, move in process_token server: infinite loop: set stop limit to true * minor: spaces * minor: spaces * server: include prompt tokens in the EOS limit
P
Pierrick Hymbert committed
7f5ff558eed0f732af8f25c2ab0645610bdec80c
Parent: 9e4e077
Committed by GitHub <noreply@github.com>
on 4/26/2024, 10:15:30 AM