SIGN IN SIGN UP

feat: Add LLM evaluators (#3571)

* Spike out LLMConcisenesseEvaluator (and more generic CriteriaEvaluator)

* Add test using llm evaluator

* Add EvaluatorFactory and define initial set of LLM-based evaluators

* Tweak type definitions

* Clean up factory-generated classes

* Improve class construction

* Update notebook to use LLM evaluator

* Use more robust label -> score mapping logic

* Address PR comments

* Use new model name

* Use inline comment for longevity

* Use different evaluator to avoid unique constraint on name in tests
D
Dustin Ngo committed
032672bd4903fb2f3832219af64afafe5af615cb
Parent: 76fdb7a
Committed by Mikyo King <mikyo@arize.com> on 7/2/2024, 3:51:15 PM