Skip to content

Comments

fix some python deps#37668

Open
claudevdm wants to merge 2 commits intoapache:masterfrom
claudevdm:fix-python-requirements
Open

fix some python deps#37668
claudevdm wants to merge 2 commits intoapache:masterfrom
claudevdm:fix-python-requirements

Conversation

@claudevdm
Copy link
Collaborator

@claudevdm claudevdm commented Feb 20, 2026

  1. Add bounds to pillow
  2. Move milvus out of test extra to ml_test
  3. Remove pythonmonkey to fix The PostCommit XVR Spark3 job is flaky #30602

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

@claudevdm
Copy link
Collaborator Author

R: @derrickaw

@claudevdm
Copy link
Collaborator Author

R: @Abacn

@gemini-code-assist
Copy link
Contributor

Summary of Changes

Hello @claudevdm, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request focuses on comprehensive maintenance of Python dependencies across various container images and Python versions. The changes involve removing outdated or unnecessary packages, updating existing dependencies to their latest stable versions, and refining the dependency management within the setup.py file to ensure consistency and compatibility. The overall goal is to improve the stability and security of the Python environments.

Highlights

  • Dependency Removals: Several Python dependencies, including aiodns, backports.zstd, brotli, milvus-lite, pminit, pycares, pymilvus, pythonmonkey, and ujson, were removed from various requirements.txt files and setup.py configurations, indicating a cleanup of unused or deprecated packages.
  • Dependency Version Updates: Numerous Python package versions were updated across all requirements.txt files. Key updates include Google Cloud libraries (e.g., google-api-core, google-cloud-bigquery-storage, google-cloud-kms, google-genai), as well as general utilities like filelock, regex, rich, Werkzeug, and greenlet. GPU-specific requirements also saw an update for cupy-cuda12x and pydantic-settings, and Python 3.13 requirements updated grpcio and related packages.
  • Setup Configuration Refinements: The setup.py file was modified to specify a version range for the pillow dependency, remove milvus_dependency from the database extra, and re-add it to the p311_ml_test and p312_ml_test extras. Additionally, pythonmonkey was removed from the dataframe extra.

🧠 New Feature in Public Preview: You can now enable Memory to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console.

Changelog
  • sdks/python/container/ml/py310/base_image_requirements.txt
    • Removed aiodns, backports.zstd, brotli, milvus-lite, pminit, pycares, pymilvus, pythonmonkey, ujson.
    • Updated filelock from 3.24.2 to 3.24.3.
    • Updated google-api-core from 2.29.0 to 2.30.0.
    • Updated google-cloud-bigquery-storage from 2.36.1 to 2.36.2.
    • Updated google-cloud-kms from 3.10.0 to 3.11.0.
    • Updated google-genai from 1.63.0 to 1.64.0.
    • Updated greenlet from 3.3.1 to 3.3.2.
    • Updated regex from 2026.1.15 to 2026.2.19.
    • Updated rich from 14.3.2 to 14.3.3.
    • Updated Werkzeug from 3.1.5 to 3.1.6.
  • sdks/python/container/ml/py310/gpu_image_requirements.txt
    • Removed milvus-lite, pymilvus, ujson.
    • Updated cupy-cuda12x from 14.0.0 to 14.0.1.
    • Updated filelock from 3.24.2 to 3.24.3.
    • Updated google-api-core from 2.29.0 to 2.30.0.
    • Updated google-cloud-bigquery-storage from 2.36.1 to 2.36.2.
    • Updated google-cloud-kms from 3.10.0 to 3.11.0.
    • Updated google-genai from 1.63.0 to 1.64.0.
    • Updated greenlet from 3.3.1 to 3.3.2.
    • Updated pydantic-settings from 2.13.0 to 2.13.1.
    • Updated regex from 2026.1.15 to 2026.2.19.
    • Updated rich from 14.3.2 to 14.3.3.
    • Updated Werkzeug from 3.1.5 to 3.1.6.
  • sdks/python/container/ml/py311/base_image_requirements.txt
    • Removed aiodns, backports.zstd, brotli, milvus-lite, pminit, pycares, pymilvus, pythonmonkey, ujson.
    • Updated filelock from 3.24.2 to 3.24.3.
    • Updated google-api-core from 2.29.0 to 2.30.0.
    • Updated google-cloud-bigquery-storage from 2.36.1 to 2.36.2.
    • Updated google-cloud-kms from 3.10.0 to 3.11.0.
    • Updated google-genai from 1.63.0 to 1.64.0.
    • Updated greenlet from 3.3.1 to 3.3.2.
    • Updated regex from 2026.1.15 to 2026.2.19.
    • Updated rich from 14.3.2 to 14.3.3.
    • Updated Werkzeug from 3.1.5 to 3.1.6.
  • sdks/python/container/ml/py311/gpu_image_requirements.txt
    • Removed milvus-lite, pymilvus, ujson.
    • Updated cupy-cuda12x from 14.0.0 to 14.0.1.
    • Updated filelock from 3.24.2 to 3.24.3.
    • Updated google-api-core from 2.29.0 to 2.30.0.
    • Updated google-cloud-bigquery-storage from 2.36.1 to 2.36.2.
    • Updated google-cloud-kms from 3.10.0 to 3.11.0.
    • Updated google-genai from 1.63.0 to 1.64.0.
    • Updated greenlet from 3.3.1 to 3.3.2.
    • Updated pydantic-settings from 2.13.0 to 2.13.1.
    • Updated regex from 2026.1.15 to 2026.2.19.
    • Updated rich from 14.3.2 to 14.3.3.
    • Updated Werkzeug from 3.1.5 to 3.1.6.
  • sdks/python/container/ml/py312/base_image_requirements.txt
    • Removed aiodns, backports.zstd, brotli, milvus-lite, pminit, pycares, pymilvus, pythonmonkey, ujson.
    • Updated filelock from 3.24.2 to 3.24.3.
    • Updated google-api-core from 2.29.0 to 2.30.0.
    • Updated google-cloud-bigquery-storage from 2.36.1 to 2.36.2.
    • Updated google-cloud-kms from 3.10.0 to 3.11.0.
    • Updated google-genai from 1.63.0 to 1.64.0.
    • Updated greenlet from 3.3.1 to 3.3.2.
    • Updated regex from 2026.1.15 to 2026.2.19.
    • Updated rich from 14.3.2 to 14.3.3.
    • Updated Werkzeug from 3.1.5 to 3.1.6.
  • sdks/python/container/ml/py312/gpu_image_requirements.txt
    • Removed milvus-lite, pymilvus, ujson.
    • Updated cupy-cuda12x from 14.0.0 to 14.0.1.
    • Updated filelock from 3.24.2 to 3.24.3.
    • Updated google-api-core from 2.29.0 to 2.30.0.
    • Updated google-cloud-bigquery-storage from 2.36.1 to 2.36.2.
    • Updated google-cloud-kms from 3.10.0 to 3.11.0.
    • Updated google-genai from 1.63.0 to 1.64.0.
    • Updated greenlet from 3.3.1 to 3.3.2.
    • Updated pydantic-settings from 2.13.0 to 2.13.1.
    • Updated regex from 2026.1.15 to 2026.2.19.
    • Updated rich from 14.3.2 to 14.3.3.
    • Updated Werkzeug from 3.1.5 to 3.1.6.
  • sdks/python/container/ml/py313/base_image_requirements.txt
    • Removed aiodns, backports.zstd, brotli, milvus-lite, pminit, pycares, pymilvus, pythonmonkey, ujson.
    • Updated filelock from 3.24.2 to 3.24.3.
    • Updated google-api-core from 2.29.0 to 2.30.0.
    • Updated google-cloud-bigquery-storage from 2.36.1 to 2.36.2.
    • Updated google-cloud-kms from 3.10.0 to 3.11.0.
    • Updated google-genai from 1.63.0 to 1.64.0.
    • Updated greenlet from 3.3.1 to 3.3.2.
    • Updated grpcio from 1.78.0 to 1.78.1.
    • Updated grpcio-status from 1.78.0 to 1.78.1.
    • Updated grpcio-tools from 1.78.0 to 1.78.1.
    • Updated regex from 2026.1.15 to 2026.2.19.
    • Updated rich from 14.3.2 to 14.3.3.
    • Updated Werkzeug from 3.1.5 to 3.1.6.
  • sdks/python/container/py310/base_image_requirements.txt
    • Removed aiodns, backports.zstd, brotli, milvus-lite, pminit, pycares, pymilvus, pythonmonkey, ujson.
    • Updated google-api-core from 2.29.0 to 2.30.0.
    • Updated google-cloud-bigquery-storage from 2.36.1 to 2.36.2.
    • Updated google-cloud-kms from 3.10.0 to 3.11.0.
    • Updated google-genai from 1.63.0 to 1.64.0.
    • Updated regex from 2026.1.15 to 2026.2.19.
  • sdks/python/container/py311/base_image_requirements.txt
    • Removed aiodns, backports.zstd, brotli, milvus-lite, pminit, pycares, pymilvus, pythonmonkey, ujson.
    • Updated google-api-core from 2.29.0 to 2.30.0.
    • Updated google-cloud-bigquery-storage from 2.36.1 to 2.36.2.
    • Updated google-cloud-kms from 3.10.0 to 3.11.0.
    • Updated google-genai from 1.63.0 to 1.64.0.
    • Updated regex from 2026.1.15 to 2026.2.19.
  • sdks/python/container/py312/base_image_requirements.txt
    • Removed aiodns, backports.zstd, brotli, milvus-lite, pminit, pycares, pymilvus, pythonmonkey, ujson.
    • Updated google-api-core from 2.29.0 to 2.30.0.
    • Updated google-cloud-bigquery-storage from 2.36.1 to 2.36.2.
    • Updated google-cloud-kms from 3.10.0 to 3.11.0.
    • Updated google-genai from 1.63.0 to 1.64.0.
    • Updated regex from 2026.1.15 to 2026.2.19.
  • sdks/python/container/py313/base_image_requirements.txt
    • Removed aiodns, backports.zstd, brotli, milvus-lite, pminit, pycares, pymilvus, pythonmonkey, ujson.
    • Updated google-api-core from 2.29.0 to 2.30.0.
    • Updated google-cloud-bigquery-storage from 2.36.1 to 2.36.2.
    • Updated google-cloud-kms from 3.10.0 to 3.11.0.
    • Updated google-genai from 1.63.0 to 1.64.0.
    • Updated grpcio from 1.78.0 to 1.78.1.
    • Updated grpcio-status from 1.78.0 to 1.78.1.
    • Updated grpcio-tools from 1.78.0 to 1.78.1.
    • Updated regex from 2026.1.15 to 2026.2.19.
  • sdks/python/setup.py
    • Updated pillow dependency to specify a version range of >=12.1.1,<13.
    • Removed milvus_dependency from the database extra.
    • Added milvus_dependency to the p311_ml_test and p312_ml_test extras.
    • Removed pythonmonkey from the dataframe extra.
Activity
  • The pull request description is generic and does not contain specific activity details.
  • The changes primarily involve updating and removing Python dependencies across multiple requirements.txt files and the setup.py configuration.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

@github-actions
Copy link
Contributor

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment assign set of reviewers

1 similar comment
@github-actions
Copy link
Contributor

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment assign set of reviewers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

The PostCommit XVR Spark3 job is flaky

2 participants