[Feature]: direct Anthropic batch processing #17265
Description
The Feature
I would like LiteLLm to support anthropic batch processing directly. According to our evaluations, their models perform the best in terms of prompt instruction's alignment. But at the moment, there is support of anthropic only through bedrock.
Motivation, pitch
I work with large data processing using LLM all the time. With the latest update from Anthropic, their models are the best for the task. The cost savings from batch processing millions of records is quite significant. So I would like to request Anthropic batch processing integration.
LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?
No
Twitter / LinkedIn details
No response