feat: Add LLM evaluators (#3571)
* Spike out LLMConcisenesseEvaluator (and more generic CriteriaEvaluator) * Add test using llm evaluator * Add EvaluatorFactory and define initial set of LLM-based evaluators * Tweak type definitions * Clean up factory-generated classes * Improve class construction * Update notebook to use LLM evaluator * Use more robust label -> score mapping logic * Address PR comments * Use new model name * Use inline comment for longevity * Use different evaluator to avoid unique constraint on name in tests
D
Dustin Ngo committed
032672bd4903fb2f3832219af64afafe5af615cb
Parent: 76fdb7a
Committed by Mikyo King <mikyo@arize.com>
on 7/2/2024, 3:51:15 PM