Skip to content

Fix NeutronConverterManager pickle error with forkserver multiprocessing (#19855)#19855

Open
JakeStevens wants to merge 1 commit into
pytorch:mainfrom
JakeStevens:export-D106689031
Open

Fix NeutronConverterManager pickle error with forkserver multiprocessing (#19855)#19855
JakeStevens wants to merge 1 commit into
pytorch:mainfrom
JakeStevens:export-D106689031

Conversation

@JakeStevens
Copy link
Copy Markdown
Contributor

@JakeStevens JakeStevens commented May 28, 2026

Summary:

Refactors convert_unsafe() to pass picklable dict instead of unpicklable module/C++ objects, adds TypeError to fallback handler (both fbcode + xplat copies)

Differential Revision: D106689031

@pytorch-bot
Copy link
Copy Markdown

pytorch-bot Bot commented May 28, 2026

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/19855

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 1 Pending, 3 Unrelated Failures

As of commit 5803585 with merge base 88faab2 (image):

NEW FAILURE - The following job has failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 28, 2026
@meta-codesync
Copy link
Copy Markdown
Contributor

meta-codesync Bot commented May 28, 2026

@JakeStevens has exported this pull request. If you are a Meta employee, you can view the originating Diff in D106689031.

@github-actions
Copy link
Copy Markdown

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@meta-codesync meta-codesync Bot changed the title Fix NeutronConverterManager pickle error with forkserver multiprocessing Fix NeutronConverterManager pickle error with forkserver multiprocessing (#19855) May 28, 2026
JakeStevens added a commit to JakeStevens/executorch that referenced this pull request May 28, 2026
…ing (pytorch#19855)

Summary:

Refactors convert_unsafe() to pass picklable dict instead of unpicklable module/C++ objects, adds TypeError to fallback handler (both fbcode + xplat copies)

Differential Revision: D106689031
JakeStevens added a commit to JakeStevens/executorch that referenced this pull request May 28, 2026
…ing (pytorch#19855)

Summary:

Refactors convert_unsafe() to pass picklable dict instead of unpicklable module/C++ objects, adds TypeError to fallback handler (both fbcode + xplat copies)

Differential Revision: D106689031
@robert-kalmar robert-kalmar added the module: nxp Issues related to NXP Neutron NPU delegation and code under backends/nxp/ label May 29, 2026
Copy link
Copy Markdown
Collaborator

@MartinPavella MartinPavella left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

With the typo and linting fixed. LGTM



def test_convert_unsafe_args_are_picklable(mocker):
"""Verify that all args passed to multiprocessing.Process are picklable.
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Typo: multiprocessing.Process

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, what is the typo? looks the same to me at least

Copy link
Copy Markdown
Collaborator

@robert-kalmar robert-kalmar May 29, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor: missing space btw. the . and the Process.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm sorry. I also thought it was supposed to be 2 sentences. I didn't realize the period was accessing the Process member of multiprocessing.

In that case, there is no typo. Just perhaps it could be surrounded with apostrophes or something, since it confused me and Robert too :D
`multiprocessing.Process`

…ing (pytorch#19855)

Summary:

Refactors convert_unsafe() to pass picklable dict instead of unpicklable module/C++ objects, adds TypeError to fallback handler (both fbcode + xplat copies)

Differential Revision: D106689031
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported meta-exported module: nxp Issues related to NXP Neutron NPU delegation and code under backends/nxp/

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants