Prepare docs for adhoc release of providers (#30787)

* Prepare docs for adhoc release of providers
apache · Apr 21, 2023 · e46ce78 · e46ce78
1 parent e4b8729
commit e46ce78
Show file tree

Hide file tree

Showing 48 changed files with 488 additions and 72 deletions.
diff --git a/airflow/providers/amazon/CHANGELOG.rst b/airflow/providers/amazon/CHANGELOG.rst
@@ -33,9 +33,10 @@ Breaking changes
 .. warning::
  In this version of the provider, deprecated GCS hook's parameter ``delegate_to`` is removed from the following operators: ``GCSToS3Operator``, ``GlacierToGCSOperator`` and ``GoogleApiToS3Operator``.
  Impersonation can be achieved instead by utilizing the ``impersonation_chain`` param.
- Also removed deprecated parameter ``google_cloud_storage_conn_id`` from ``GCSToS3Operator``, ``gcp_conn_id`` should be used instead.
 
- The deprecated parameter ``max_tries`` was removed from the Athena & EMR hook & operators in favor of ``max_polling_attempts``.
+ Removed deprecated parameter ``google_cloud_storage_conn_id`` from ``GCSToS3Operator``, ``gcp_conn_id`` should be used instead.
+
+ Removed deprecated parameter ``max_tries`` from the Athena & EMR hook & operators in favor of ``max_polling_attempts``.
 
  Disabled deprecated behavior of switching to an empty aws connection ID on error. You can set it to None explicitly.
 
@@ -63,6 +64,36 @@ Breaking changes
 
  Removed deprecated and unused param ``s3_conn_id`` from ``ImapAttachmentToS3Operator``, ``MongoToS3Operator`` and ``S3ToSFTPOperator``.
 
+* ``remove delegate_to from GCP operators and hooks (#30748)``
+* ``Remove deprecated code from Amazon provider (#30755)``
+
+Features
+~~~~~~~~
+
+* ``add a stop operator to emr serverless (#30720)``
+* ``SqlToS3Operator - Add feature to partition SQL table (#30460)``
+* ``New AWS sensor — DynamoDBValueSensor (#28338)``
+
+Bug Fixes
+~~~~~~~~~
+
+* ``Fixed logging issue (#30703)``
+* ``DynamoDBHook - waiter_path() to consider 'resource_type' or 'client_type' (#30595)``
+* ``Add ability to override waiter delay in EcsRunTaskOperator (#30586)``
+* ``Add support in AWS Batch Operator for multinode jobs (#29522)``
+* ``AWS logs. Exit fast when 3 consecutive responses are returned from AWS Cloudwatch logs (#30756)``
+
+Misc
+~~~~
+
+* ``Remove @poke_mode_only from EmrStepSensor (#30774)``
+* ``Organize Amazon providers docs index (#30541)``
+* ``Remove duplicate param docstring in EksPodOperator (#30634)``
+
+.. Below changes are excluded from the changelog. Move them to
+ appropriate section above if needed. Do not delete the lines(!):
+ * ``Decouple "job runner" from BaseJob ORM model (#30255)``
+
 7.4.1
 .....
 

diff --git a/airflow/providers/apache/beam/CHANGELOG.rst b/airflow/providers/apache/beam/CHANGELOG.rst
@@ -34,6 +34,11 @@ Breaking changes
  In this version of the provider, deprecated GCS and Dataflow hooks' param ``delegate_to`` is removed from all Beam operators.
  Impersonation can be achieved instead by utilizing the ``impersonation_chain`` param.
 
+* ``remove delegate_to from GCP operators and hooks (#30748)``
+
+.. Review and move the new changes to one of the sections above:
+ * ``Add mechanism to suspend providers (#30422)``
+
 4.3.0
 .....
 

diff --git a/airflow/providers/cncf/kubernetes/CHANGELOG.rst b/airflow/providers/cncf/kubernetes/CHANGELOG.rst
@@ -24,6 +24,21 @@
 Changelog
 ---------
 
+6.1.0
+.....
+
+Features
+~~~~~~~~
+
+* ``Add multiple exit code handling in skip logic for 'DockerOperator' and 'KubernetesPodOperator' (#30769)``
+* ``Skip KubernetesPodOperator task when it returns a provided exit code (#29000)``
+
+
+.. Below changes are excluded from the changelog. Move them to
+ appropriate section above if needed. Do not delete the lines(!):
+ * ``Deprecate 'skip_exit_code' in 'DockerOperator' and 'KubernetesPodOperator' (#30733)``
+ * ``Remove skip_exit_code from KubernetesPodOperator (#30788)``
+
 6.0.0
 .....
 

diff --git a/airflow/providers/cncf/kubernetes/provider.yaml b/airflow/providers/cncf/kubernetes/provider.yaml
@@ -23,6 +23,7 @@ description: |
 
 suspended: false
 versions:
+ - 6.1.0
  - 6.0.0
  - 5.3.0
  - 5.2.2

diff --git a/airflow/providers/databricks/CHANGELOG.rst b/airflow/providers/databricks/CHANGELOG.rst
@@ -24,6 +24,20 @@
 Changelog
 ---------
 
+4.1.0
+.....
+
+Features
+~~~~~~~~
+
+* ``Add delete inactive run functionality to databricks provider (#30646)``
+* ``Databricks SQL sensor (#30477)``
+
+
+.. Below changes are excluded from the changelog. Move them to
+ appropriate section above if needed. Do not delete the lines(!):
+ * ``Add mechanism to suspend providers (#30422)``
+
 4.0.1
 .....
 

diff --git a/airflow/providers/databricks/provider.yaml b/airflow/providers/databricks/provider.yaml
@@ -23,6 +23,7 @@ description: |
 
 suspended: false
 versions:
+ - 4.1.0
  - 4.0.1
  - 4.0.0
  - 3.4.0

diff --git a/airflow/providers/dbt/cloud/CHANGELOG.rst b/airflow/providers/dbt/cloud/CHANGELOG.rst
@@ -24,6 +24,20 @@
 Changelog
 ---------
 
+3.1.1
+.....
+
+Misc
+~~~~
+
+* ``Merge DbtCloudJobRunAsyncSensor logic to DbtCloudJobRunSensor (#30227)``
+* ``Move typing imports behind TYPE_CHECKING in DbtCloudHook (#29989)``
+
+.. Below changes are excluded from the changelog. Move them to
+ appropriate section above if needed. Do not delete the lines(!):
+ * ``Add mechanism to suspend providers (#30422)``
+ * ``adding trigger info to provider yaml (#29950)``
+
 3.1.0
 .....
 

diff --git a/airflow/providers/dbt/cloud/provider.yaml b/airflow/providers/dbt/cloud/provider.yaml
@@ -23,6 +23,7 @@ description: |
 
 suspended: false
 versions:
+ - 3.1.1
  - 3.1.0
  - 3.0.0
  - 2.3.1

diff --git a/airflow/providers/docker/CHANGELOG.rst b/airflow/providers/docker/CHANGELOG.rst
@@ -24,6 +24,26 @@
 Changelog
 ---------
 
+3.6.0
+.....
+
+Features
+~~~~~~~~
+
+* ``Add multiple exit code handling in skip logic for 'DockerOperator' and 'KubernetesPodOperator' (#30769)``
+* ``In 'DockerOperator', adding an attribute 'tls_verify' to choose whether to validate certificate (#30309) (#30310)``
+
+Misc
+~~~~
+
+* ``Deprecate 'skip_exit_code' in 'DockerOperator' and 'KubernetesPodOperator' (#30733)``
+
+.. Below changes are excluded from the changelog. Move them to
+ appropriate section above if needed. Do not delete the lines(!):
+ * ``Fix and augment 'check-for-inclusive-language' CI check (#29549)``
+ * ``Remove "boilerplate" from all taskflow decorators (#30118)``
+ * ``Add mechanism to suspend providers (#30422)``
+
 3.5.1
 .....
 

diff --git a/airflow/providers/docker/provider.yaml b/airflow/providers/docker/provider.yaml
@@ -23,6 +23,7 @@ description: |
 
 suspended: false
 versions:
+ - 3.6.0
  - 3.5.1
  - 3.5.0
  - 3.4.0

diff --git a/airflow/providers/google/CHANGELOG.rst b/airflow/providers/google/CHANGELOG.rst
@@ -38,6 +38,20 @@ default api version for Campaign Manager 360 operator was updated to the latest
  transfer operators that interact with GCS. Impersonation can be achieved instead by utilizing the ``impersonation_chain`` param.
  The ``delegate_to`` param will still be available only in gsuite and marketing platform hooks and operators, that don't interact with Google Cloud.
 
+* ``remove delegate_to from GCP operators and hooks (#30748)``
+* ``Update Google Campaign Manager360 operators to use API v4 (#30598)``
+
+Bug Fixes
+~~~~~~~~~
+
+* ``Update DataprocCreateCluster operator to use 'label' parameter properly (#30741)``
+
+Misc
+~~~~
+
+* ``add missing project_id in BigQueryGetDataOperator (#30651)``
+* ``Display Video 360 cleanup v1 API usage (#30577)``
+
 9.0.0
 .....
 

diff --git a/airflow/providers/microsoft/azure/CHANGELOG.rst b/airflow/providers/microsoft/azure/CHANGELOG.rst
@@ -34,6 +34,13 @@ Breaking changes
  In this version of the provider, deprecated GCS hook's param ``delegate_to`` is removed from ``AzureBlobStorageToGCSOperator``.
  Impersonation can be achieved instead by utilizing the ``impersonation_chain`` param.
 
+* ``remove delegate_to from GCP operators and hooks (#30748)``
+
+Misc
+~~~~
+
+* ``Merge WasbBlobAsyncSensor to WasbBlobSensor (#30488)``
+
 5.3.1
 .....
 
@@ -66,6 +73,7 @@ Bug Fixes
 
 Misc
 ~~~~
+
 * ``merge AzureDataFactoryPipelineRunStatusAsyncSensor to AzureDataFactoryPipelineRunStatusSensor (#30250)``
 * ``Expose missing params in AzureSynapseHook API docs (#30099)``
 

diff --git a/airflow/providers/mysql/CHANGELOG.rst b/airflow/providers/mysql/CHANGELOG.rst
@@ -15,10 +15,6 @@
  specific language governing permissions and limitations
  under the License.
 
-The version of MySQL server has to be 5.6.4+. The exact version upper bound depends
-on the version of ``mysqlclient`` package. For example, ``mysqlclient`` 1.3.12 can only be
-used with MySQL server 5.6.4 through 5.7.
-
 .. NOTE TO CONTRIBUTORS:
  Please, only add notes to the Changelog just below the "Changelog" header when there are some breaking changes
  and you want to add an explanation to the users on how they are supposed to deal with them.
@@ -27,6 +23,22 @@ used with MySQL server 5.6.4 through 5.7.
 Changelog
 ---------
 
+5.0.0
+.....
+
+Breaking changes
+~~~~~~~~~~~~~~~~
+
+.. warning::
+ If you are using mysql-connector-python please note that starting this release it is an extra option.
+ The library will not be installed by default.
+
+* ``Remove mysql-connector-python (#30487)``
+
+.. Below changes are excluded from the changelog. Move them to
+ appropriate section above if needed. Do not delete the lines(!):
+ * ``Add mechanism to suspend providers (#30422)``
+
 4.0.2
 .....
 

diff --git a/airflow/providers/mysql/provider.yaml b/airflow/providers/mysql/provider.yaml
@@ -23,6 +23,7 @@ description: |
 
 suspended: false
 versions:
+ - 5.0.0
  - 4.0.2
  - 4.0.1
  - 4.0.0

diff --git a/airflow/providers/presto/CHANGELOG.rst b/airflow/providers/presto/CHANGELOG.rst
@@ -34,6 +34,10 @@ Breaking changes
  In this version of the provider, deprecated GCS hook's param ``delegate_to`` is removed from ``GCSToPrestoOperator``.
  Impersonation can be achieved instead by utilizing the ``impersonation_chain`` param.
 
+* ``remove delegate_to from GCP operators and hooks (#30748)``
+
+.. Review and move the new changes to one of the sections above:
+ * ``Add mechanism to suspend providers (#30422)``
 
 4.2.2
 .....

diff --git a/airflow/providers/snowflake/CHANGELOG.rst b/airflow/providers/snowflake/CHANGELOG.rst
@@ -24,6 +24,18 @@
 Changelog
 ---------
 
+4.0.5
+.....
+
+Misc
+~~~~
+
+* ``Update documentation for snowflake provider 4.0 breaking change (#30020)``
+
+.. Below changes are excluded from the changelog. Move them to
+ appropriate section above if needed. Do not delete the lines(!):
+ * ``Add mechanism to suspend providers (#30422)``
+
 4.0.4
 .....
 

diff --git a/airflow/providers/snowflake/provider.yaml b/airflow/providers/snowflake/provider.yaml
@@ -23,6 +23,7 @@ description: |
 
 suspended: false
 versions:
+ - 4.0.5
  - 4.0.4
  - 4.0.3
  - 4.0.2

diff --git a/airflow/providers/sqlite/CHANGELOG.rst b/airflow/providers/sqlite/CHANGELOG.rst
@@ -24,6 +24,18 @@
 Changelog
 ---------
 
+3.3.2
+.....
+
+Misc
+~~~~
+
+* ``Use connection URI in SqliteHook (#28721)``
+
+.. Below changes are excluded from the changelog. Move them to
+ appropriate section above if needed. Do not delete the lines(!):
+ * ``Add mechanism to suspend providers (#30422)``
+
 3.3.1
 .....
 

diff --git a/airflow/providers/sqlite/provider.yaml b/airflow/providers/sqlite/provider.yaml
@@ -23,6 +23,7 @@ description: |
 
 suspended: false
 versions:
+ - 3.3.2
  - 3.3.1
  - 3.3.0
  - 3.2.1

diff --git a/airflow/providers/trino/CHANGELOG.rst b/airflow/providers/trino/CHANGELOG.rst
@@ -34,6 +34,11 @@ Breaking changes
  In this version of the provider, deprecated GCS hook's param ``delegate_to`` is removed from ``GCSToPrestoOperator``.
  Impersonation can be achieved instead by utilizing the ``impersonation_chain`` param.
 
+* ``remove delegate_to from GCP operators and hooks (#30748)``
+
+.. Review and move the new changes to one of the sections above:
+ * ``Add mechanism to suspend providers (#30422)``
+
 4.3.2
 .....
 

diff --git a/docs/apache-airflow-providers-amazon/commits.rst b/docs/apache-airflow-providers-amazon/commits.rst
@@ -28,14 +28,39 @@ For high-level changelog, see :doc:`package information including changelog <ind
 
 
 
+8.0.0
+.....
+
+Latest change: 2023-04-21
+
+================================================================================================= =========== ===================================================================================================
+Commit Committed Subject
+================================================================================================= =========== ===================================================================================================
+`e4b8729739 <https://github.com/apache/airflow/commit/e4b8729739ec1ff67a00d7f778f4bf07eec33a8e>`_ 2023-04-21 ``Remove deprecated code from Amazon provider (#30755)``
+`7e01c09644 <https://github.com/apache/airflow/commit/7e01c096446dbd134e0efa144e7de87b800639a1>`_ 2023-04-21 ``AWS logs. Exit fast when 3 consecutive responses are returned from AWS Cloudwatch logs (#30756)``
+`8a191938b6 <https://github.com/apache/airflow/commit/8a191938b62edcce8093d2522759ede960a00f5f>`_ 2023-04-21 ``Remove @poke_mode_only from EmrStepSensor (#30774)``
+`fbc1382514 <https://github.com/apache/airflow/commit/fbc13825140cc6cc6b3d4b27db6d329692a1c451>`_ 2023-04-21 ``remove delegate_to from GCP operators and hooks (#30748)``
+`c14bc770f6 <https://github.com/apache/airflow/commit/c14bc770f697fd980550ff308571174a094a0ed5>`_ 2023-04-19 ``add a stop operator to emr serverless (#30720)``
+`d7cef588d6 <https://github.com/apache/airflow/commit/d7cef588d6f6a749bd5e8fbf3153a275f4120ee8>`_ 2023-04-19 ``SqlToS3Operator - Add feature to partition SQL table (#30460)``
+`221249e872 <https://github.com/apache/airflow/commit/221249e8726d4082634912a27840011771f713be>`_ 2023-04-18 ``Fixed logging issue (#30703)``
+`38f2b4a4df <https://github.com/apache/airflow/commit/38f2b4a4dfb1485d664a468680978e73317f9a76>`_ 2023-04-14 ``Organize Amazon providers docs index (#30541)``
+`7c2d3617bf <https://github.com/apache/airflow/commit/7c2d3617bf1be0781e828d3758ee6d9c6490d0f0>`_ 2023-04-14 ``DynamoDBHook - waiter_path() to consider 'resource_type' or 'client_type' (#30595)``
+`51f9910ecb <https://github.com/apache/airflow/commit/51f9910ecbf1186aff164e09d118bdf04d21dfcb>`_ 2023-04-14 ``Remove duplicate param docstring in EksPodOperator (#30634)``
+`96661789cc <https://github.com/apache/airflow/commit/96661789ccfd6798677cd7f15e987e24c1e9db1b>`_ 2023-04-14 ``New AWS sensor — DynamoDBValueSensor (#28338)``
+`92cab74b28 <https://github.com/apache/airflow/commit/92cab74b280e9e7162120506c46fe275fbe0b577>`_ 2023-04-12 ``Add ability to override waiter delay in EcsRunTaskOperator (#30586)``
+`2ce1130006 <https://github.com/apache/airflow/commit/2ce11300064ec821ffe745980012100fc32cb4b4>`_ 2023-04-11 ``Add support in AWS Batch Operator for multinode jobs (#29522)``
+`58294c5440 <https://github.com/apache/airflow/commit/58294c5440608b1a58828cbae36f91b7148c04b4>`_ 2023-04-10 ``Decouple "job runner" from BaseJob ORM model (#30255)``
+================================================================================================= =========== ===================================================================================================
+
 7.4.1
 .....
 
-Latest change: 2023-04-05
+Latest change: 2023-04-09
 
 ================================================================================================= =========== ==========================================================================
 Commit Committed Subject
 ================================================================================================= =========== ==========================================================================
+`874ea9588e <https://github.com/apache/airflow/commit/874ea9588e3ce7869759440302e53bb6a730a11e>`_ 2023-04-09 ``Prepare docs for ad hoc release of Providers (#30545)``
 `fa4fb1f5fe <https://github.com/apache/airflow/commit/fa4fb1f5fe6f8dfd00d9956197e01efa0a95e24a>`_ 2023-04-05 ``Revert "Add AWS deferrable BatchOperator (#29300)" (#30489)``
 `c1b5eafc82 <https://github.com/apache/airflow/commit/c1b5eafc8201b8c84f34fdf21fa1d000b97c13e8>`_ 2023-04-05 ``Add more info to quicksight error messages (#30466)``
 `77c272e6e8 <https://github.com/apache/airflow/commit/77c272e6e8ecda0ce48917064e58ba14f6a15844>`_ 2023-04-05 ``Add AWS deferrable BatchOperator (#29300)``