Skip to content

Commit

Permalink
Prepares documentation for rc2 release of Providers (#16501)
Browse files Browse the repository at this point in the history
* adds clear information that the provider is for 2.1+
* adds explicit dependency to apache-airflow>=2.1.0 in dependency list
* adds capability of specifying additional dependencies
* different providers now can depend on different Airflow version
* removed pre-commit check and provider info update for
  provider-schema 2.0.0 compatibility
  (not needed any more after >= 2.1.0 is used as Airflow >2.0.1
  allows additional properties in provider_info)
* Update changelog documentation for all providers

Co-authored-by: jarek <jarek@penguini>
  • Loading branch information
potiuk and jarek committed Jun 18, 2021
1 parent db10c68 commit bbc627a
Show file tree
Hide file tree
Showing 269 changed files with 825 additions and 602 deletions.
199 changes: 0 additions & 199 deletions airflow/deprecated_schemas/provider-2.0.0.yaml.schema.json

This file was deleted.

7 changes: 7 additions & 0 deletions airflow/provider.yaml.schema.json
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,13 @@
"type": "string"
}
},
"additional-dependencies": {
"description": "Additional dependencies that should be added to the provider",
"type": "array",
"items": {
"type": "string"
}
},
"integrations": {
"description": "List of integrations supported by the provider.",
"type": "array",
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/airbyte/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,7 @@ Bug Fixes
* ``Updated documentation for June 2021 provider release (#16294)``
* ``Add missing docstring params (#15741)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
1.0.0
.....
Expand Down
3 changes: 3 additions & 0 deletions airflow/providers/airbyte/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,9 @@ versions:
- 2.0.0
- 1.0.0

additional-dependencies:
- apache-airflow>=2.1.0

integrations:
- integration-name: Airbyte
external-doc-url: https://www.airbyte.io/
Expand Down
4 changes: 4 additions & 0 deletions airflow/providers/amazon/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,8 @@ Features
* ``Remove the 'not-allow-trailing-slash' rule on S3_hook (#15609)``
* ``Add support of capacity provider strategy for ECSOperator (#15848)``
* ``Update copy command for s3 to redshift (#16241)``
* ``Make job name check optional in SageMakerTrainingOperator (#16327)``
* ``Add AWS DMS replication task operators (#15850)``

Bug Fixes
~~~~~~~~~
Expand All @@ -48,6 +50,7 @@ Bug Fixes
* ``Fix spacing in 'AwsBatchWaitersHook' docstring (#15839)``
* ``MongoToS3Operator failed when running with a single query (not aggregate pipeline) (#15680)``
* ``fix: AwsGlueJobOperator change order of args for load_file (#16216)``
* ``Fix S3ToFTPOperator (#13796)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
Expand All @@ -61,6 +64,7 @@ Bug Fixes
* ``Fix spelling (#15699)``
* ``Add Connection Documentation for Providers (#15499)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
1.4.0
.....
Expand Down
3 changes: 3 additions & 0 deletions airflow/providers/amazon/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,9 @@ versions:
- 1.1.0
- 1.0.0

additional-dependencies:
- apache-airflow>=2.1.0

integrations:
- integration-name: Amazon Athena
external-doc-url: https://aws.amazon.com/athena/
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/beam/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,7 @@ Breaking changes
* ``Rename example bucket names to use INVALID BUCKET NAME by default (#15651)``
* ``Updated documentation for June 2021 provider release (#16294)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
2.0.0
.....
Expand Down
3 changes: 3 additions & 0 deletions airflow/providers/apache/beam/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,9 @@ versions:
- 1.0.1
- 1.0.0

additional-dependencies:
- apache-airflow>=2.1.0

integrations:
- integration-name: Apache Beam
external-doc-url: https://beam.apache.org/
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/cassandra/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,7 @@ Breaking changes
* ``Update documentation for broken package releases (#14734)``
* ``Updated documentation for June 2021 provider release (#16294)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
1.0.1
.....
Expand Down
3 changes: 3 additions & 0 deletions airflow/providers/apache/cassandra/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,9 @@ versions:
- 1.0.1
- 1.0.0

additional-dependencies:
- apache-airflow>=2.1.0

integrations:
- integration-name: Apache Cassandra
external-doc-url: http://cassandra.apache.org/
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/druid/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,7 @@ Breaking changes
* ``Remove Backport Providers (#14886)``
* ``Updated documentation for June 2021 provider release (#16294)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
1.1.0
.....
Expand Down
3 changes: 3 additions & 0 deletions airflow/providers/apache/druid/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,9 @@ versions:
- 1.0.1
- 1.0.0

additional-dependencies:
- apache-airflow>=2.1.0

integrations:
- integration-name: Apache Druid
external-doc-url: https://druid.apache.org/
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/hdfs/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,7 @@ Breaking changes
* ``Update Docstrings of Modules with Missing Params (#15391)``
* ``Created initial guide for HDFS operators (#11212)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
1.0.1
.....
Expand Down
3 changes: 3 additions & 0 deletions airflow/providers/apache/hdfs/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,9 @@ versions:
- 1.0.1
- 1.0.0

additional-dependencies:
- apache-airflow>=2.1.0

integrations:
- integration-name: Hadoop Distributed File System (HDFS)
external-doc-url: https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/hive/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,7 @@ Breaking changes
* ``Updated documentation for June 2021 provider release (#16294)``
* ``Add Connection Documentation for the Hive Provider (#15704)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
1.0.3
.....
Expand Down
3 changes: 3 additions & 0 deletions airflow/providers/apache/hive/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,9 @@ versions:
- 1.0.1
- 1.0.0

additional-dependencies:
- apache-airflow>=2.1.0

integrations:
- integration-name: Apache Hive
external-doc-url: https://hive.apache.org/
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/kylin/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,7 @@ Breaking changes
* ``Updated documentation for June 2021 provider release (#16294)``
* ``Update KylinHook docstring (#15602)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
1.0.1
.....
Expand Down
3 changes: 3 additions & 0 deletions airflow/providers/apache/kylin/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,9 @@ versions:
- 1.0.1
- 1.0.0

additional-dependencies:
- apache-airflow>=2.1.0

integrations:
- integration-name: Apache Kylin
external-doc-url: https://kylin.apache.org/
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/livy/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ Breaking changes
appropriate section above if needed. Do not delete the lines(!):
* ``Updated documentation for June 2021 provider release (#16294)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
1.1.0
.....
Expand Down
3 changes: 3 additions & 0 deletions airflow/providers/apache/livy/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,9 @@ versions:
- 1.0.1
- 1.0.0

additional-dependencies:
- apache-airflow>=2.1.0

integrations:
- integration-name: Apache Livy
external-doc-url: https://livy.apache.org/
Expand Down

0 comments on commit bbc627a

Please sign in to comment.