Skip to content

[cli] report all quant backends in diffusers-cli env.#13728

Open
sayakpaul wants to merge 3 commits into
mainfrom
report-quant-backends-cli
Open

[cli] report all quant backends in diffusers-cli env.#13728
sayakpaul wants to merge 3 commits into
mainfrom
report-quant-backends-cli

Conversation

@sayakpaul
Copy link
Copy Markdown
Member

@sayakpaul sayakpaul commented May 12, 2026

What does this PR do?

Report all quantization backends in diffusers-cli env to make it more comprehensive. It now unfolds to something like:

Copy-and-paste the text below in your GitHub issue and FILL OUT the two last points.

- 🤗 Diffusers version: 0.39.0.dev0
- Platform: Linux-5.15.0-1048-aws-x86_64-with-glibc2.31
- Running on Google Colab?: No
- Python version: 3.12.12
- PyTorch version (GPU?): 2.11.0+cu129 (True)
- Flax version (CPU?/GPU?/TPU?): not installed (NA)
- Jax version: not installed
- JaxLib version: not installed
- Huggingface_hub version: 1.11.0
- Transformers version: 5.6.0.dev0
- Accelerate version: 1.12.0
- PEFT version: 0.18.2.dev0
- bitsandbytes version: 0.49.0
- gguf version: 0.19.0
- optimum-quanto version: not installed
- torchao version: 0.17.0
- nvidia-modelopt version: not installed
- Safetensors version: 0.7.0
- xFormers version: not installed
- Accelerator: NVIDIA H100 80GB HBM3, 81559 MiB
- Using GPU in script?: <fill in>
- Using distributed or parallel set-up in script?: <fill in>

@github-actions github-actions Bot added utils size/S PR with diff < 50 LOC labels May 12, 2026
@sayakpaul sayakpaul requested review from DN6 and yiyixuxu May 12, 2026 09:11
import bitsandbytes

bitsandbytes_version = bitsandbytes.__version__
quantization_versions = {}
Copy link
Copy Markdown
Collaborator

@DN6 DN6 May 13, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the backend isn't available, I'd say it's better to skip adding it to the final message entirely. Keeps the logs less noisy.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@sayakpaul sayakpaul requested a review from DN6 May 13, 2026 09:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size/S PR with diff < 50 LOC utils

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants