The Feature
Vertex AI passthrough is missing cost attribution for these endpoints:
/predict
/batchPredictionJobs
Motivation, pitch
We rely on passthrough APIs as a fallback mechanism. In the past, there have been cases where a provider introduced a new API argument, model, or feature that wasn’t supported by litellm. we’d like our passthrough APIs to emit metrics and support cost tracking for our top providers
LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?
No
Twitter / LinkedIn details
No response