Fix group offloading for quanto-quantized models#14038

Sunt-ing wants to merge 2 commits into

huggingface:mainhuggingface/diffusers:mainfrom

Sunt-ing:0Sunt-ing/diffusers:0Copy head branch name to clipboard