The Feature

Thanks for making prometheus metrics OSS! It has been very helpful!
Some metrics which will benefit everyone will be

• request queue time (server process time - arrival time)
• guardrail invocation latency/error/qps metrics

Motivation, pitch

I am working on adding observability in litellm internals and having these new metrics are a low hanging fruit to add

LiteLLM is hiring a founding backend engineer, are you interested in joining us and shipping to all our users?

No

Twitter / LinkedIn details

No response