-
Notifications
You must be signed in to change notification settings - Fork 1.8k
Open
Labels
General perf<NV>Broad performance issues not specific to a particular component<NV>Broad performance issues not specific to a particular componentPerformanceTRTLLM model inference speed, throughput, efficiency. Latency, benchmarks, regressions, opts.TRTLLM model inference speed, throughput, efficiency. Latency, benchmarks, regressions, opts.
Description
Proposal to improve performance
No response
Report of performance regression
No response
Misc discussion on performance
No response
Your current environment (if you think it is necessary)
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.
Metadata
Metadata
Assignees
Labels
General perf<NV>Broad performance issues not specific to a particular component<NV>Broad performance issues not specific to a particular componentPerformanceTRTLLM model inference speed, throughput, efficiency. Latency, benchmarks, regressions, opts.TRTLLM model inference speed, throughput, efficiency. Latency, benchmarks, regressions, opts.
Type
Projects
Status
In progress