[WIP] Rolling KV cache for autoregressive generation#12773

zucchini-nlp wants to merge 4 commits intohuggingface:mainhuggingface/diffusers:mainfrom

zucchini-nlp:rolling-kv-cachezucchini-nlp/diffusers:rolling-kv-cacheCopy head branch name to clipboard