Fix some Transformers nightly tests#29802

Isotr0py merged 2 commits intovllm-project:mainvllm-project/vllm:mainfrom

hmellor:fix-some-testshmellor/vllm:fix-some-testsCopy head branch name to clipboard