SIGN IN SIGN UP

feat(evals): in `llm_classify`, use function calling to constrain LLM outputs when available; `llm_classify` now returns a dataframe (#1651)

* implement FunctionCallingClassifier with unit tests

* refactor response into openai response

* check input model type

* clean test case

* rename classifiers to evaluators

* fix types and styles

* rename

* fix unit tests

* remove evaluate method

* stylistic improvement

* add docstrings

* clean docstring

* update docstring

* update docstrings

* reduce PR scope by removing customizability of functions

* fix typo

* add toggle for disabling function calling

* add support indicator on model for function calling

* fix typo

* differentiate older azure api versions

* fix type check

* add code comments

* clean up

* fix type check

* remove with_explanation

* fix wording

* return dataframe instead of list

* update usage in README

* improve comments

* update notebooks

* add tests for column position

* clean up

* fix comment

* bump version

---------

Co-authored-by: Roger Yang <roger.yang@arize.com>
X
Xander Song committed
b796cb4057846574d0cd7a3e3c078b7f6ef5ee91
Parent: 8d95b6d
Committed by GitHub <noreply@github.com> on 10/31/2023, 3:52:57 PM