Skip to content

Add warning when using CUDA random generator (#13298) #13309

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
r266-tech wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Add warning when using CUDA random generator (#13298) #13309

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions src/diffusers/utils/torch_utils.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -176,6 +176,12 @@ def randn_tensor(
)
elif gen_device_type != device.type and gen_device_type == "cuda":
raise ValueError(f"Cannot generate a {device} tensor from a generator of type {gen_device_type}.")
elif gen_device_type == "cuda" and device.type == "cuda":
logger.warning(
"Using a CUDA random generator may produce different results than a CPU generator with the same seed."
" This is expected because PyTorch uses different random number generation algorithms on CPU and CUDA."
" If you need reproducible results across devices, use a CPU generator (e.g., torch.Generator('cpu'))."
)

# make sure generator list of length 1 is treated like a non-list
if isinstance(generator, list) and len(generator) == 1:
Expand Down