Skip to content

Commit

Permalink
Corrections in docs and tools after releasing provider RCs (#14082)
Browse files Browse the repository at this point in the history
  • Loading branch information
potiuk committed Feb 5, 2021
1 parent fc67521 commit 10343ec
Show file tree
Hide file tree
Showing 50 changed files with 252 additions and 38 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------------------------|
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
| [01049ddce](https://github.com/apache/airflow/commit/01049ddce210f475d6eae9b1cb306f750a1d6dd8) | 2021-01-31 | `Add aws ses email backend for use with EmailOperator. (#13986)` |
| [ecfdc60bb](https://github.com/apache/airflow/commit/ecfdc60bb607fe0d13fa7e315476c607813abab6) | 2021-01-29 | `Add bucket_name to template fileds in S3 operators (#13973)` |
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/amazon/BACKPORT_PROVIDER_README.md
Original file line number Diff line number Diff line change
Expand Up @@ -310,6 +310,7 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------------------------|
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
| [01049ddce](https://github.com/apache/airflow/commit/01049ddce210f475d6eae9b1cb306f750a1d6dd8) | 2021-01-31 | `Add aws ses email backend for use with EmailOperator. (#13986)` |
| [ecfdc60bb](https://github.com/apache/airflow/commit/ecfdc60bb607fe0d13fa7e315476c607813abab6) | 2021-01-29 | `Add bucket_name to template fileds in S3 operators (#13973)` |
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@


### Release 2021.2.5

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:--------------------------------------------------------------------------|
| [d45739f7c](https://github.com/apache/airflow/commit/d45739f7ce0de183329d67fff88a9da3943a9280) | 2021-02-04 | `Fixes to release process after releasing 2nd wave of providers (#14059)` |
| [1872d8719](https://github.com/apache/airflow/commit/1872d8719d24f94aeb1dcba9694837070b9884ca) | 2021-02-03 | `Add Apache Beam operators (#12814)` |
44 changes: 30 additions & 14 deletions airflow/providers/apache/beam/BACKPORT_PROVIDER_README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@

# Package apache-airflow-backport-providers-apache-beam

Release:
Release: 2021.2.5

**Table of contents**

Expand All @@ -30,13 +30,11 @@ Release:
- [Cross provider package dependencies](#cross-provider-package-dependencies)
- [Provider class summary](#provider-classes-summary)
- [Operators](#operators)
- [Moved operators](#moved-operators)
- [Transfer operators](#transfer-operators)
- [Moved transfer operators](#moved-transfer-operators)
- [New operators](#new-operators)
- [Hooks](#hooks)
- [Moved hooks](#moved-hooks)
- [New hooks](#new-hooks)
- [Releases](#releases)
- [Release](#release)
- [Release 2021.2.5](#release-202125)

## Backport package

Expand All @@ -49,11 +47,18 @@ While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade pyth
want to use this backport package.



## Installation

You can install this package on top of an existing airflow 1.10.* installation via
`pip install apache-airflow-backport-providers-apache-beam`

## PIP requirements

| PIP package | Version required |
|:-------------------|:-------------------|
| `apache-beam[gcp]` | |

## Cross provider package dependencies

Those are dependencies that might be needed in order to use all the features of the package.
Expand All @@ -65,10 +70,9 @@ You can install such cross-provider dependencies when installing from PyPI. For
pip install apache-airflow-backport-providers-apache-beam[google]
```

| Dependent package | Extra |
|:----------------------------------------------------------------------------------------------------------|:------------|
| [apache-airflow-providers-apache-google](https://pypi.org/project/apache-airflow-providers-apache-google) | google |

| Dependent package | Extra |
|:-------------------------------------------------------------------------------------------------------------------|:---------|
| [apache-airflow-backport-providers-google](https://github.com/apache/airflow/tree/master/airflow/providers/google) | `google` |

# Provider classes summary

Expand All @@ -79,21 +83,33 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

## Operators


### New operators

| New Airflow 2.0 operators: `airflow.providers.apache.beam` package |
|:-----------------------------------------------------------------------------------------------------------------------------------------------|
| [operators.beam.BeamRunJavaPipelineOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/beam/operators/beam.py) |
| [operators.beam.BeamRunPythonPipelineOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/beam/operators/beam.py) |
| New Airflow 2.0 operators: `airflow.providers.apache.beam` package |
|:----------------------------------------------------------------------------------------------------------------------------------------------|
| [operators.beam.BeamRunJavaPipelineOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/beam/operators/beam.py) |
| [operators.beam.BeamRunPythonPipelineOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/beam/operators/beam.py) |



## Hooks


### New hooks

| New Airflow 2.0 hooks: `airflow.providers.apache.beam` package |
|:-----------------------------------------------------------------------------------------------------------------|
| [hooks.beam.BeamHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/beam/hooks/beam.py) |




## Releases

### Release 2021.2.5

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:--------------------------------------------------------------------------|
| [d45739f7c](https://github.com/apache/airflow/commit/d45739f7ce0de183329d67fff88a9da3943a9280) | 2021-02-04 | `Fixes to release process after releasing 2nd wave of providers (#14059)` |
| [1872d8719](https://github.com/apache/airflow/commit/1872d8719d24f94aeb1dcba9694837070b9884ca) | 2021-02-03 | `Add Apache Beam operators (#12814)` |
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------|
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
| [a9ac2b040](https://github.com/apache/airflow/commit/a9ac2b040b64de1aa5d9c2b9def33334e36a8d22) | 2021-01-23 | `Switch to f-strings using flynt. (#13732)` |
| [5f81fc73c](https://github.com/apache/airflow/commit/5f81fc73c8ea3fc1c3b08080f439fa123926f250) | 2021-01-03 | `Fix: Remove password if in LDAP or CUSTOM mode HiveServer2Hook (#11767)` |
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/apache/hive/BACKPORT_PROVIDER_README.md
Original file line number Diff line number Diff line change
Expand Up @@ -162,6 +162,7 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------|
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
| [a9ac2b040](https://github.com/apache/airflow/commit/a9ac2b040b64de1aa5d9c2b9def33334e36a8d22) | 2021-01-23 | `Switch to f-strings using flynt. (#13732)` |
| [5f81fc73c](https://github.com/apache/airflow/commit/5f81fc73c8ea3fc1c3b08080f439fa123926f250) | 2021-01-03 | `Fix: Remove password if in LDAP or CUSTOM mode HiveServer2Hook (#11767)` |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------------------------|
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
| [a9ac2b040](https://github.com/apache/airflow/commit/a9ac2b040b64de1aa5d9c2b9def33334e36a8d22) | 2021-01-23 | `Switch to f-strings using flynt. (#13732)` |
| [1b9e3d1c2](https://github.com/apache/airflow/commit/1b9e3d1c285cb381f2f964c0c923711cd5e1e3d0) | 2021-01-22 | `Revert "Fix error with quick-failing tasks in KubernetesPodOperator (#13621)" (#13835)` |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -131,6 +131,7 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------------------------|
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
| [a9ac2b040](https://github.com/apache/airflow/commit/a9ac2b040b64de1aa5d9c2b9def33334e36a8d22) | 2021-01-23 | `Switch to f-strings using flynt. (#13732)` |
| [1b9e3d1c2](https://github.com/apache/airflow/commit/1b9e3d1c285cb381f2f964c0c923711cd5e1e3d0) | 2021-01-22 | `Revert "Fix error with quick-failing tasks in KubernetesPodOperator (#13621)" (#13835)` |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------------|
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
| [ba54afe58](https://github.com/apache/airflow/commit/ba54afe58b7cbd3711aca23252027fbd034cca41) | 2021-01-31 | `Remove failed DockerOperator tasks with auto_remove=True (#13532) (#13993)` |
| [25d68a7a9](https://github.com/apache/airflow/commit/25d68a7a9e0b4481486552ece9e77bcaabfa4de2) | 2021-01-30 | `Fix error on DockerSwarmOperator with auto_remove True (#13532) (#13852)` |
Expand Down
1 change: 1 addition & 0 deletions airflow/providers/docker/BACKPORT_PROVIDER_README.md
Original file line number Diff line number Diff line change
Expand Up @@ -105,6 +105,7 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------------|
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
| [ba54afe58](https://github.com/apache/airflow/commit/ba54afe58b7cbd3711aca23252027fbd034cca41) | 2021-01-31 | `Remove failed DockerOperator tasks with auto_remove=True (#13532) (#13993)` |
| [25d68a7a9](https://github.com/apache/airflow/commit/25d68a7a9e0b4481486552ece9e77bcaabfa4de2) | 2021-01-30 | `Fix error on DockerSwarmOperator with auto_remove True (#13532) (#13852)` |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------|
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
| [3fd5ef355](https://github.com/apache/airflow/commit/3fd5ef355556cf0ad7896bb570bbe4b2eabbf46e) | 2021-01-21 | `Add missing logos for integrations (#13717)` |
| [295d66f91](https://github.com/apache/airflow/commit/295d66f91446a69610576d040ba687b38f1c5d0a) | 2020-12-30 | `Fix Grammar in PIP warning (#13380)` |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -93,6 +93,7 @@ in [Naming conventions for provider packages](https://github.com/apache/airflow/

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------|
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
| [3fd5ef355](https://github.com/apache/airflow/commit/3fd5ef355556cf0ad7896bb570bbe4b2eabbf46e) | 2021-01-21 | `Add missing logos for integrations (#13717)` |
| [295d66f91](https://github.com/apache/airflow/commit/295d66f91446a69610576d040ba687b38f1c5d0a) | 2020-12-30 | `Fix Grammar in PIP warning (#13380)` |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@

| Commit | Committed | Subject |
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------|
| [88bdcfa0d](https://github.com/apache/airflow/commit/88bdcfa0df5bcb4c489486e05826544b428c8f43) | 2021-02-04 | `Prepare to release a new wave of providers. (#14013)` |
| [ac2f72c98](https://github.com/apache/airflow/commit/ac2f72c98dc0821b33721054588adbf2bb53bb0b) | 2021-02-01 | `Implement provider versioning tools (#13767)` |
| [d0ab7f6d3](https://github.com/apache/airflow/commit/d0ab7f6d3a2976167f9c4fb309c502a4f866f983) | 2021-01-25 | `Add ExasolToS3Operator (#13847)` |
| [3fd5ef355](https://github.com/apache/airflow/commit/3fd5ef355556cf0ad7896bb570bbe4b2eabbf46e) | 2021-01-21 | `Add missing logos for integrations (#13717)` |
Expand Down

0 comments on commit 10343ec

Please sign in to comment.