server : refactor multitask handling (#9274)
* server : remove multitask from server_task * refactor completions handler * fix embeddings * use res_ok everywhere * small change for handle_slots_action * use unordered_set everywhere * (try) fix test * no more "mutable" lambda * Apply suggestions from code review Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> * use deque --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
X
Xuan Son Nguyen committed
6e7d133a5f9409dd257fad90d7f320721b07a1b2
Parent: b60074f
Committed by GitHub <noreply@github.com>
on 9/2/2024, 3:11:51 PM