Implement Anthropic prompt caching (#16274)

Release Notes:

- Adds support for Prompt Caching in Anthropic. For models that support
it this can dramatically lower cost while improving performance.

Roy Williams committed 2y ago

46fb917e02cf2a440637be6965ef40d05872f9f7

Parent: 09b6e3f

Committed by GitHub <noreply@github.com> on 8/16/2024, 3:21:06 AM