feat: `create_evaluator` decorators (#3642)
* Spike out generic evaluator decorator * Flesh out type annotations * Add informative signature bind error messages * Add tests for decorator evaluators * Improve binding magic * Update tests * Ruff 🐶 * Improve error message * Un-nest `results` from output if possible * Ruff 🐶 * Use more robust output un-nesting * Use updated kwarg * Swap evaluator argument order * Finish swapping evaluator order * 'experiment_input' -> 'input' * Change validator to allow `input` parameter name
D
Dustin Ngo committed
56acddd54ab06ee80c5fa98aac80e9a5144c6787
Parent: 8314aa5
Committed by Mikyo King <mikyo@arize.com>
on 7/2/2024, 3:51:16 PM