Update token limits automatically

[karlrissland]

Motivation

Shouldn't have to go in and manually make a setting adjustment.

How would you feel if this feature request was implemented?

Deployment would feel more professional and complete

Share a gif from giphy to tells us how you'd feel. Format:

Requirements

A list of requirements to consider this feature delivered

• Install Application
• LLM token limits set appropriately
• ...

Tasks

To be filled in by the engineer picking up the issue

• Task 1
• Task 2
• ...

[Vinay-Microsoft]

Thanks @karlrissland for reporting this, we will add it in our product backlog

[github-actions]

This issue is stale because it has been open 180 days with no activity. Remove stale label or comment, or it will be closed in 30 days.