Skip to content

[Feature]: Vertex AI Passthrough – Add Cost Attribution Support #13733

@aunt-bitsy

Description

@aunt-bitsy

The Feature

Vertex AI passthrough is missing cost attribution for these endpoints:

/predict
/batchPredictionJobs

Motivation, pitch

We rely on passthrough APIs as a fallback mechanism. In the past, there have been cases where a provider introduced a new API argument, model, or feature that wasn’t supported by litellm. we’d like our passthrough APIs to emit metrics and support cost tracking for our top providers

LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

No

Twitter / LinkedIn details

No response

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions