SIGN IN SIGN UP

feat: Add async submission to `llm_generate` (#1965)

* Create an internal PhoenixException class that can be caught

* Extract executors into their own module

* Add tests and fix sync executor retry logic

* Add tests for retry behavior

* Implement llm_generate using executors

* Lazily initialize async primitives in rate limiter

* Manage termination event lifecycle in executors

* Revert to using `get_executor_on_sync_context`

* Add typing information

* Improve sigint handling test

* Update tests for executor refactor

* Use correct fallback values for `llm_generate`

* Use SIGUSR1 to test signal handling instead of SIGINT

* Address PR feedback
D
Dustin Ngo committed
59991331c93d4f994f00745124b73602d84cc95d
Parent: 1fb8faf
Committed by GitHub <noreply@github.com> on 12/16/2023, 9:10:05 PM