Skip to content

Fix group offloading for quanto-quantized models#14038

Open
Sunt-ing wants to merge 2 commits into
huggingface:mainfrom
Sunt-ing:0
Open

Fix group offloading for quanto-quantized models#14038
Sunt-ing wants to merge 2 commits into
huggingface:mainfrom
Sunt-ing:0

Narrow group offloading fix to quanto tensors

7612f35
Select commit
Loading
Failed to load commit list.
Sign in for the full log view