SIGN IN SIGN UP

server : refactored the task processing logic (#5065)

* server: add llama_server_queue struct

* server: add llama_server_response_event

* server: add comments

* server: move all mutexes away from server.cpp

* server: correct multitask response

* server: only add back deferred tasks when one slot is available

* server: fix a race condition cause by "request_completion"
X
Xuan Son Nguyen committed
48c857aa10aea73210a4a72da3f1a6f99269e75d
Parent: 413e7b0
Committed by GitHub <noreply@github.com> on 1/26/2024, 12:42:20 PM