Skip to content

Arm backend: Avoid shared qspec bridges for uint8 IO#20976

Merged
bdemirb merged 4 commits into
pytorch:mainfrom
bdemirb:baris/1286639-avoid-shared-qspec-uint8
Jul 17, 2026
Merged

Arm backend: Avoid shared qspec bridges for uint8 IO#20976
bdemirb merged 4 commits into
pytorch:mainfrom
bdemirb:baris/1286639-avoid-shared-qspec-uint8

Conversation

@bdemirb

@bdemirb bdemirb commented Jul 16, 2026

Copy link
Copy Markdown
Collaborator

When preserved uint8 model IO is used, SharedQspecQuantizer can merge image-scale tensors with wider internal activation ranges.

Avoid using cat, concatenate, stack, pixel_shuffle, and slice as fallback shared-qspec bridge ops for graphs with uint8 IO. This keeps normal int8 quantisation behaviour unchanged while preserving image input qparams for uint8 IO flows.

Add a regression test covering image-like uint8 IO joined with a high-range branch.

cc @digantdesai @freddan80 @per @zingo @oscarandersson8218 @mansnils @Sebastian-Larsson @robell @rascani

When preserved uint8 model IO is used, SharedQspecQuantizer can
merge image-scale tensors with wider internal activation ranges.

Avoid using cat, concatenate, stack, pixel_shuffle, and slice as
fallback shared-qspec bridge ops for graphs with uint8 IO. This keeps
normal int8 quantization behaviour unchanged while preserving image
input qparams for uint8 IO flows.

Add a regression test covering image-like uint8 IO joined with a
high-range branch.

Signed-off-by: Baris Demir <baris.demir@arm.com>
Change-Id: Ieeb1cf59e606674ac34050ebe21fc080740cc567
@bdemirb
bdemirb requested a review from digantdesai as a code owner July 16, 2026 13:26
@pytorch-bot

pytorch-bot Bot commented Jul 16, 2026

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/20976

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit be2e87b with merge base f6cef83 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 16, 2026
@github-actions github-actions Bot added ciflow/trunk module: arm Issues related to arm backend labels Jul 16, 2026
@bdemirb

bdemirb commented Jul 16, 2026

Copy link
Copy Markdown
Collaborator Author

@pytorchbot label "partner: arm"

@pytorch-bot pytorch-bot Bot added the partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm label Jul 16, 2026
@bdemirb

bdemirb commented Jul 16, 2026

Copy link
Copy Markdown
Collaborator Author

@pytorchbot label "release notes: arm"

@pytorch-bot pytorch-bot Bot added the release notes: arm Changes to the ARM backend delegate label Jul 16, 2026
@bdemirb
bdemirb merged commit 47fd0d8 into pytorch:main Jul 17, 2026
494 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. module: arm Issues related to arm backend partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm release notes: arm Changes to the ARM backend delegate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants