it run good on rtx 5060 ti 16 gb

[kmnnmk212-source]

System Info

https://github.com/kmnnmk212-source/suc-nvidia-TensorRT-LLM/blob/main/11.txt

Who can help?

/

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

/

Expected behavior

;

actual behavior

;

additional notes

;

Before submitting a new issue...

• Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

[kmnnmk212-source]

11.txt

[kmnnmk212-source]

1.py

[karljang]

@kmnnmk212-source ,
Would you mind clarifying the problem you're referring to? I’m not sure I fully understand what’s being reported.