Skip to content

[SPARK-56860][PYTHON] Remove unused CogroupArrowUDFSerializer#55868

Open
Yicong-Huang wants to merge 1 commit into
apache:masterfrom
Yicong-Huang:SPARK-56860/cleanup/cogroup-arrow-udf-serializer
Open

[SPARK-56860][PYTHON] Remove unused CogroupArrowUDFSerializer#55868
Yicong-Huang wants to merge 1 commit into
apache:masterfrom
Yicong-Huang:SPARK-56860/cleanup/cogroup-arrow-udf-serializer

Conversation

@Yicong-Huang
Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Delete CogroupArrowUDFSerializer from python/pyspark/sql/pandas/serializers.py.

Why are the changes needed?

CogroupArrowUDFSerializer is no longer used after SPARK-56312 refactored SQL_COGROUPED_MAP_ARROW_UDF to use ArrowStreamCoGroupSerializer directly. This class can be safely deleted.

Part of SPARK-55384.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Existing tests: pyspark.sql.tests.arrow.test_arrow_cogrouped_map.

Was this patch authored or co-authored using generative AI tooling?

No.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants