feat(experiments): Implement `run_experiment` (#3471)
* Sketch out run_experiment * Make evals required * Correctly use example protocol * Set up full end-to-end clientside testing and write experiment test * Clean up type annotations * Ruff 🐶 * Update type annotations for evals * Clean up experiment runner * Fix syntax error * Revert evals changes * Restore deleted space * Use independent rate limiters * Do not explicitly import `run_experiments` at the top level * Rename type annotations for domain-specificity
D
Dustin Ngo committed
87a05015a53541c06e51f52d4cd0d1ab65d9e2ba
Parent: 0bdb860
Committed by Mikyo King <mikyo@arize.com>
on 7/2/2024, 3:51:14 PM