Skip to content

Commit

Permalink
Prepare docs for Jan 2023 wave of Providers (#28651)
Browse files Browse the repository at this point in the history
* Prepare docs for Jan 2023 wave of Providers

* update
  • Loading branch information
eladkal committed Jan 2, 2023
1 parent 81cd6c7 commit 5246c00
Show file tree
Hide file tree
Showing 87 changed files with 780 additions and 94 deletions.
37 changes: 37 additions & 0 deletions airflow/providers/amazon/CHANGELOG.rst
Expand Up @@ -38,11 +38,48 @@ Pandas is now an optional dependency of the provider. The ``SqlToS3Operator`` an
require Pandas to be installed (you can install it automatically by adding ``[pandas]`` extra when installing
the provider.

* ``Make pandas dependency optional for Amazon Provider (#28505)``

Features
~~~~~~~~

* ``Deprecate 'full_url_mode' for SecretsManagerBackend; whether a secret is a JSON or URL is inferred (#27920)``
* ``Add execution role parameter to AddStepsOperator (#28484)``
* ``Add AWS SageMaker operator to register a model's version (#28024)``
* ``Add link for EMR Steps Sensor logs (#28180)``
* ``Add Amazon Elastic Container Registry (ECR) Hook (#28279)``
* ``Add EMR Notebook operators (#28312)``
* ``Create 'LambdaCreateFunctionOperator' and sensor (#28241)``
* ``Better support for Boto Waiters (#28236)``
* ``Amazon Provider Package user agent (#27823)``
* ``Allow waiter to be configured via EmrServerless Operators (#27784)``
* ``Add operators + sensor for aws sagemaker pipelines (#27786)``
* ``Update RdsHook docstrings to match correct argument names (#28108)``
* ``add some important log in aws athena hook (#27917)``
* ``Lambda hook: make runtime and handler optional (#27778)``

Bug Fixes
~~~~~~~~~

* ``Fix EmrAddStepsOperature wait_for_completion parameter is not working (#28052)``
* ``Correctly template Glue Jobs 'create_job_kwargs' arg (#28403)``
* ``Fix template rendered bucket_key in S3KeySensor (#28340)``
* ``Fix Type Error while using DynamoDBToS3Operator (#28158)``
* ``AWSGlueJobHook updates job configuration if it exists (#27893)``
* ``Fix GlueCrawlerOperature failure when using tags (#28005)``

Misc
~~~~

* ``Fix S3KeySensor documentation (#28297)``
* ``Improve docstrings for 'AwsLambdaInvokeFunctionOperator' (#28233)``
* ``Remove outdated compat imports/code from providers (#28507)``
* ``add description of breaking changes (#28582)``
* ``[misc] Get rid of 'pass' statement in conditions (#27775)``
* ``[misc] Replace XOR '^' conditions by 'exactly_one' helper in providers (#27858)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
6.2.0
.....
Expand Down
5 changes: 5 additions & 0 deletions airflow/providers/apache/hive/CHANGELOG.rst
Expand Up @@ -33,6 +33,11 @@ Features
The ``apache.hive`` provider provides now hive macros that used to be provided by Airflow. As of 5.1.0 version
of ``apache.hive`` the hive macros are provided by the Provider.

* ``Move Hive macros to the provider (#28538)``
* ``Make pandas dependency optional for Amazon Provider (#28505)``

.. Review and move the new changes to one of the sections above:
5.0.0
.....

Expand Down
30 changes: 30 additions & 0 deletions airflow/providers/cncf/kubernetes/CHANGELOG.rst
Expand Up @@ -24,6 +24,36 @@
Changelog
---------

5.1.0
.....

Features
~~~~~~~~

* ``Add Flink on K8s Operator (#28512)``
* ``Add volume-related nested template fields for KPO (#27719)``
* ``Allow longer pod names for k8s executor / KPO (#27736)``
* ``Use labels instead of pod name for pod log read in k8s exec (#28546)``

Bug Fixes
~~~~~~~~~

* ``Patch "checked" when pod not successful (#27845)``
* ``Keep pod name for k8s executor under 63 characters (#28237)``

Misc
~~~~

* ``Remove outdated compat imports/code from providers (#28507)``
* ``Restructure Docs (#27235)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Updated docs for RC3 wave of providers (#27937)``
* ``Prepare for follow-up relase for November providers (#27774)``
.. Review and move the new changes to one of the sections above:
5.0.0
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/cncf/kubernetes/provider.yaml
Expand Up @@ -22,6 +22,7 @@ description: |
`Kubernetes <https://kubernetes.io/>`__
versions:
- 5.1.0
- 5.0.0
- 4.4.0
- 4.3.0
Expand Down
19 changes: 19 additions & 0 deletions airflow/providers/common/sql/CHANGELOG.rst
Expand Up @@ -24,6 +24,25 @@
Changelog
---------

1.3.2
.....

Bug Fixes
~~~~~~~~~

* ``fIx isort problems introduced by recent isort release (#28434)``
* ``Fix template rendering for Common SQL operators (#28202)``
* ``Defer to hook setting for split_statements in SQLExecuteQueryOperator (#28635)``

Misc
~~~~

* ``Clarify docstrings for updated DbApiHook (#27966)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add pre-commits preventing accidental API changes in common.sql (#27962)``
1.3.1
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/common/sql/provider.yaml
Expand Up @@ -22,6 +22,7 @@ description: |
`Common SQL Provider <https://en.wikipedia.org/wiki/SQL>`__
versions:
- 1.3.2
- 1.3.1
- 1.3.0
- 1.2.0
Expand Down
14 changes: 14 additions & 0 deletions airflow/providers/docker/CHANGELOG.rst
Expand Up @@ -24,6 +24,20 @@
Changelog
---------

3.4.0
.....

Features
~~~~~~~~

* ``add hostname argument to DockerOperator (#27822)``
* ``Move min airflow version down for Docker Provider to 2.3.0 (#28648)``


.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
3.3.0
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/docker/provider.yaml
Expand Up @@ -22,6 +22,7 @@ description: |
`Docker <https://docs.docker.com/install/>`__
versions:
- 3.4.0
- 3.3.0
- 3.2.0
- 3.1.0
Expand Down
10 changes: 10 additions & 0 deletions airflow/providers/elasticsearch/CHANGELOG.rst
Expand Up @@ -24,6 +24,16 @@
Changelog
---------

4.3.2
.....

Bug Fixes
~~~~~~~~~
* ``Support restricted index patterns in Elasticsearch log handler (#23888)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
4.3.1
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/elasticsearch/provider.yaml
Expand Up @@ -22,6 +22,7 @@ description: |
`Elasticsearch <https://www.elastic.co/elasticsearch>`__
versions:
- 4.3.2
- 4.3.1
- 4.3.0
- 4.2.1
Expand Down
12 changes: 12 additions & 0 deletions airflow/providers/ftp/CHANGELOG.rst
Expand Up @@ -24,6 +24,18 @@
Changelog
---------

3.3.0
.....

Features
~~~~~~~~

* ``Add FTPSFileTransmitOperator (#28318)``
* ``Add 'FTPFileTransmitOperator' (#26974)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
3.2.0
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/ftp/provider.yaml
Expand Up @@ -22,6 +22,7 @@ description: |
`File Transfer Protocol (FTP) <https://tools.ietf.org/html/rfc114>`__
versions:
- 3.3.0
- 3.2.0
- 3.1.0
- 3.0.0
Expand Down
37 changes: 37 additions & 0 deletions airflow/providers/google/CHANGELOG.rst
Expand Up @@ -23,6 +23,43 @@
Changelog
---------

8.7.0
.....

Features
~~~~~~~~

* ``Add table_resource to template fields for BigQueryCreateEmptyTableOperator (#28235)``
* ``Add retry param in GCSObjectExistenceSensor (#27943)``
* ``Add preserveAsciiControlCharacters to src_fmt_configs (#27679)``
* ``Add deferrable mode to CloudBuildCreateBuildOperator (#27783)``
* ``GCSToBigQueryOperator allows autodetect None and infers schema (#28564)``
* ``Improve memory usage in Dataproc deferrable operators (#28117)``
* ``Push job_id in xcom for dataproc submit job op (#28639)``

Bug Fixes
~~~~~~~~~

* ``Fix for issue with reading schema fields for JSON files in GCSToBigQueryOperator (#28284)``
* ``Fix GCSToBigQueryOperator not respecting schema_obj (#28444)``
* ``Fix GCSToGCSOperator copying list of objects without wildcard (#28111)``
* ``Fix: re-enable use of parameters in gcs_to_bq which had been disabled (#27961)``
* ``Set bigquery ''use_legacy_sql'' param in job config correctly (#28522)``

Misc
~~~~
* ``Remove 'pylint' messages control instructions (#28555)``
* ``Remove deprecated AIPlatformConsoleLinkk from google/provider.yaml (#28449)``
* ``Use object instead of array in config.yml for config template (#28417)``
* ``[misc] Get rid of 'pass' statement in conditions (#27775)``
* ``Change log level to DEBUG when secret not found for google secret manager (#27856)``
* ``[misc] Replace XOR '^' conditions by 'exactly_one' helper in providers (#27858)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
.. Review and move the new changes to one of the sections above:
8.6.0
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/google/provider.yaml
Expand Up @@ -29,6 +29,7 @@ description: |
- `Google Workspace <https://workspace.google.com/>`__ (formerly Google Suite)
versions:
- 8.7.0
- 8.6.0
- 8.5.0
- 8.4.0
Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/grpc/.latest-doc-only-change.txt
@@ -1 +1 @@
2e20e9f7ebf5f43bf27069f4c0063cdd72e6b2e2
25bdbc8e6768712bad6043618242eec9c6632618
10 changes: 10 additions & 0 deletions airflow/providers/imap/CHANGELOG.rst
Expand Up @@ -24,6 +24,16 @@
Changelog
---------

3.1.1
.....

Misc
~~~~
* ``[misc] Get rid of 'pass' statement in conditions (#27775)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
3.1.0
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/imap/provider.yaml
Expand Up @@ -23,6 +23,7 @@ description: |
`Internet Message Access Protocol (IMAP) <https://tools.ietf.org/html/rfc3501>`__
versions:
- 3.1.1
- 3.1.0
- 3.0.0
- 2.2.3
Expand Down
10 changes: 10 additions & 0 deletions airflow/providers/microsoft/azure/CHANGELOG.rst
Expand Up @@ -24,6 +24,16 @@
Changelog
---------

5.0.2
.....

Misc
~~~~
* ``Re-enable azure service bus on ARM as it now builds cleanly (#28442)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
5.0.1
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/microsoft/azure/provider.yaml
Expand Up @@ -21,6 +21,7 @@ name: Microsoft Azure
description: |
`Microsoft Azure <https://azure.microsoft.com/>`__
versions:
- 5.0.2
- 5.0.1
- 5.0.0
- 4.3.0
Expand Down
10 changes: 10 additions & 0 deletions airflow/providers/microsoft/mssql/CHANGELOG.rst
Expand Up @@ -24,6 +24,16 @@
Changelog
---------

3.3.2
.....

Misc
~~~~
* ``Re-enable 'pymsql' on ARM as it now builds cleanly (#28530)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
3.3.1
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/microsoft/mssql/provider.yaml
Expand Up @@ -22,6 +22,7 @@ description: |
`Microsoft SQL Server (MSSQL) <https://www.microsoft.com/en-us/sql-server/sql-server-downloads>`__
versions:
- 3.3.2
- 3.3.1
- 3.3.0
- 3.2.1
Expand Down
10 changes: 10 additions & 0 deletions airflow/providers/microsoft/winrm/CHANGELOG.rst
Expand Up @@ -24,6 +24,16 @@
Changelog
---------

3.1.1
.....

Misc
~~~~
* ``Remove outdated compat imports/code from providers (#28507)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
3.1.0
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/microsoft/winrm/provider.yaml
Expand Up @@ -22,6 +22,7 @@ description: |
`Windows Remote Management (WinRM) <https://docs.microsoft.com/en-us/windows/win32/winrm/portal>`__
versions:
- 3.1.1
- 3.1.0
- 3.0.0
- 2.0.5
Expand Down
10 changes: 10 additions & 0 deletions airflow/providers/oracle/CHANGELOG.rst
Expand Up @@ -24,6 +24,16 @@
Changelog
---------

3.6.0
.....

Features
~~~~~~~~
* ``XCOM push ORA error code in OracleStoredProcedure (#27319)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
3.5.1
.....

Expand Down

0 comments on commit 5246c00

Please sign in to comment.