Do you consider release quantized model and lightweight version

[LJXLJXLJX]

Thanks for your great job. The results are stunning, but the VRAM barrier to entry is too high.

[GinChow]

We’re working on adding a model offloading strategy to cut down VRAM usage during inference. A quantized version of the model is also on the way😃