Skip to content

Add Python 3.13 support for Airflow. #46891

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

potiuk
Copy link
Member

@potiuk potiuk commented Feb 19, 2025

Added Python 3.13 support across the codebase, including:

  • CI/CD workflow updates to handle Python 3.13.
  • Dockerfile and environment variable adjustments for compatibility.
  • Documentation updates to list Python 3.13 as supported.
  • Dependency and code changes for compatibility with new/changed
    libraries (e.g., numpy 2.x, greenlet, pendulum).
  • Test and plugin manager adjustments for Python 3.13-specific behaviors.
  • Removal or skipping of tests and features not compatible with Python 3.13.
  • Improved error handling and logging for unsupported plugins/providers
    on Python 3.13.
  • Updated all provider README.rst files to:
    • List Python 3.13 as a supported version.
    • Adjust dependency requirements for Python 3.13 (e.g., pandas,
      pyarrow, ray, etc.).
    • Add or update notes about excluded or conditionally supported
      dependencies for Python 3.13.
    • Document any known incompatibilities or workarounds for specific
      providers.
  • Updated all provider pyproject.toml files and automation to:
    • Add Python 3.13 to the supported classifiers.
    • Adjust requires-python and dependency constraints for Python 3.13.
    • Exclude Python 3.13 for providers that are not yet compatible (e.g.,
      those depending on Flask AppBuilder).
    • Add conditional dependencies for new versions of libraries required
      by Python 3.13.
  • Updated Breeze and related scripts to:
  • Build and test with Python 3.13.
  • Update documentation and release scripts to include Python 3.13.
  • Ensure all dev tooling and test environments work with Python 3.13.

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@potiuk potiuk force-pushed the add-python-3-13-support branch from 9888b0f to f4f2031 Compare February 19, 2025 17:16
@potiuk potiuk added the legacy api Whether legacy API changes should be allowed in PR label Feb 19, 2025
@potiuk potiuk force-pushed the add-python-3-13-support branch 3 times, most recently from 9c6e93c to b40bf29 Compare February 19, 2025 17:44
@potiuk potiuk force-pushed the add-python-3-13-support branch from b40bf29 to 21a34cb Compare February 19, 2025 18:22
@Lee-W Lee-W self-requested a review February 20, 2025 07:04
@potiuk potiuk force-pushed the add-python-3-13-support branch 2 times, most recently from 004dd04 to ec6553d Compare February 20, 2025 15:41
@potiuk potiuk mentioned this pull request Feb 23, 2025
@potiuk potiuk force-pushed the add-python-3-13-support branch 4 times, most recently from 9d382f4 to 25c5d7a Compare March 1, 2025 16:21
@potiuk potiuk force-pushed the add-python-3-13-support branch 3 times, most recently from 50fc7ee to be6b595 Compare March 9, 2025 21:52
@potiuk potiuk force-pushed the add-python-3-13-support branch 3 times, most recently from 4cf2cc3 to b9c8b2b Compare April 13, 2025 12:26
@potiuk potiuk added full tests needed We need to run full set of tests for this PR to merge all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs labels Apr 13, 2025
@potiuk potiuk force-pushed the add-python-3-13-support branch 2 times, most recently from 5e1cd92 to c85447f Compare April 13, 2025 13:32
@potiuk potiuk force-pushed the add-python-3-13-support branch 3 times, most recently from e39c0f9 to 2d88b64 Compare April 27, 2025 21:07
@potiuk potiuk force-pushed the add-python-3-13-support branch 2 times, most recently from decbe3e to 0bb2e6b Compare June 21, 2025 13:19
@potiuk potiuk changed the title Add support for Python 3.13 Add Python 3.13 support for Airflow. Jun 21, 2025
@potiuk potiuk force-pushed the add-python-3-13-support branch 11 times, most recently from 0f9a599 to 228a5b6 Compare June 23, 2025 19:36
@potiuk potiuk force-pushed the add-python-3-13-support branch 6 times, most recently from f397ef9 to cb3489f Compare June 29, 2025 18:59
@potiuk potiuk force-pushed the add-python-3-13-support branch from cb3489f to 8c3a21e Compare June 30, 2025 21:42
potiuk added 3 commits July 1, 2025 00:17
Added Python 3.13 support across the codebase, including:
* CI/CD workflow updates to handle Python 3.13.
* Dockerfile and environment variable adjustments for compatibility.
* Documentation updates to list Python 3.13 as supported.
* Dependency and code changes for compatibility with new/changed
  libraries (e.g., numpy 2.x, greenlet, pendulum).
* Test and plugin manager adjustments for Python 3.13-specific behaviors.
* Removal or skipping of tests and features not compatible with Python 3.13.
* Improved error handling and logging for unsupported plugins/providers
  on Python 3.13.
* Updated all provider README.rst files to:
  * List Python 3.13 as a supported version.
  * Adjust dependency requirements for Python 3.13 (e.g., pandas,
    pyarrow, ray, etc.).
  * Add or update notes about excluded or conditionally supported
    dependencies for Python 3.13.
  * Document any known incompatibilities or workarounds for specific
    providers.
* Updated all provider pyproject.toml files and automation to:
  * Add Python 3.13 to the supported classifiers.
  * Adjust requires-python and dependency constraints for Python 3.13.
  * Exclude Python 3.13 for providers that are not yet compatible (e.g.,
    those depending on Flask AppBuilder).
  * Add conditional dependencies for new versions of libraries required
    by Python 3.13.
* Updated Breeze and related scripts to:
 * Build and test with Python 3.13.
 * Update documentation and release scripts to include Python 3.13.
 * Ensure all dev tooling and test environments work with Python 3.13.
@potiuk potiuk force-pushed the add-python-3-13-support branch from 8c3a21e to b15f31e Compare June 30, 2025 22:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs area:dev-tools full tests needed We need to run full set of tests for this PR to merge legacy api Whether legacy API changes should be allowed in PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants