Release candidate 2 for backport packages 2020.05.20 (#8898)

Release candidate 2 for backport packages 2020.05.20
apache · May 19, 2020 · 375d1ca · 375d1ca
1 parent dd57ec9
commit 375d1ca
Show file tree

Hide file tree

Showing 132 changed files with 947 additions and 327 deletions.
diff --git a/BREEZE.rst b/BREEZE.rst
@@ -655,7 +655,7 @@ This is the current syntax for `./breeze <./breeze>`_:
  cleanup-image Cleans up the container image created
  exec Execs into running breeze container in new terminal
  generate-requirements Generates pinned requirements for pip dependencies
- generate-backport-readme Generates backport packages readme files
+ prepare-backport-readme  Prepares backport packages readme files
  prepare-backport-packages Prepares backport packages
  initialize-local-virtualenv Initializes local virtualenv
  setup-autocomplete Sets up autocomplete for breeze
@@ -872,9 +872,9 @@ This is the current syntax for `./breeze <./breeze>`_:
  ####################################################################################################
 
 
- Detailed usage for command: generate-backport-readme
+ Detailed usage for command: prepare-backport-readme
 
- breeze [FLAGS] generate-backport-readme -- <EXTRA_ARGS>
+ breeze [FLAGS] prepare-backport-readme -- <EXTRA_ARGS>
 
  Prepares README.md files for backport packages. You can provide (after --) optional version
  in the form of YYYY.MM.DD, optionally followed by the list of packages to generate readme for.
@@ -884,13 +884,13 @@ This is the current syntax for `./breeze <./breeze>`_:
 
  Examples:
 
- 'breeze generate-backport-readme' or
- 'breeze generate-backport-readme -- 2020.05.10' or
- 'breeze generate-backport-readme -- 2020.05.10 https google amazon'
+ 'breeze prepare-backport-readme' or
+ 'breeze prepare-backport-readme -- 2020.05.10' or
+ 'breeze prepare-backport-readme -- 2020.05.10 https google amazon'
 
  General form:
 
- 'breeze generate-backport-readme -- YYYY.MM.DD <PACKAGE_ID> ...'
+ 'breeze prepare-backport-readme -- YYYY.MM.DD <PACKAGE_ID> ...'
 
  * YYYY.MM.DD - is the CALVER version of the package to prepare. Note that this date
  cannot be earlier than the already released version (the script will fail if it
@@ -917,29 +917,34 @@ This is the current syntax for `./breeze <./breeze>`_:
 
  Builds backport packages. You can provide (after --) optional list of packages to prepare.
  If no packages are specified, readme for all packages are generated. You can specify optional
- --version-suffix flag to generate rc candidates for the packages.
-
- Make sure to set the right version in './backport_packages/setup_backport_packages.py'
+ --version-suffix-for-svn flag to generate rc candidate packages to upload to SVN or
+ --version-suffix-for-pypi flag to generate rc candidates for PyPI packages.
 
  Examples:
 
  'breeze prepare-backport-packages' or
  'breeze prepare-backport-packages -- google' or
- 'breeze prepare-backport-packages --version-suffix rc1 -- http google amazon'
+ 'breeze prepare-backport-packages --version-suffix-for-svn rc1 -- http google amazon' or
+ 'breeze prepare-backport-packages --version-suffix-for-pypi rc1 -- http google amazon'
 
  General form:
 
- 'breeze prepare-backport-packages -- <PACKAGE_ID> ...'
+ 'breeze prepare-backport-packages \
+ [--version-suffix-for-svn|--version-suffix-for-pypi] -- <PACKAGE_ID> ...'
 
  * <PACKAGE_ID> is usually directory in the airflow/providers folder (for example
  'google'), but in several cases, it might be one level deeper separated with '.'
  for example 'apache.hive'
 
  Flags:
 
- -S, --version-suffix
- Adds optional suffix to the generated backport package version. It can be used to generate
- rc1/rc2 ... versions of the packages.
+ -S, --version-suffix-for-pypi
+ Adds optional suffix to the version in the generated backport package. It can be used
+ to generate rc1/rc2 ... versions of the packages to be uploaded to PyPI.
+
+ -N, --version-suffix-for-svn
+ Adds optional suffix to the generated names of package. It can be used to generate
+ rc1/rc2 ... versions of the packages to be uploaded to SVN.
 
  -v, --verbose
  Show verbose information about executed commands (enabled by default for running test).
@@ -1423,9 +1428,13 @@ This is the current syntax for `./breeze <./breeze>`_:
  ****************************************************************************************************
  Flags for generation of the backport packages
 
- -S, --version-suffix
- Adds optional suffix to the generated backport package version. It can be used to generate
- rc1/rc2 ... versions of the packages.
+ -S, --version-suffix-for-pypi
+ Adds optional suffix to the version in the generated backport package. It can be used
+ to generate rc1/rc2 ... versions of the packages to be uploaded to PyPI.
+
+ -N, --version-suffix-for-svn
+ Adds optional suffix to the generated names of package. It can be used to generate
+ rc1/rc2 ... versions of the packages to be uploaded to SVN.
 
  ****************************************************************************************************
  Increase verbosity of the scripts

diff --git a/airflow/providers/amazon/PROVIDERS_CHANGES_2020.05.20.md b/airflow/providers/amazon/PROVIDERS_CHANGES_2020.05.20.md
@@ -4,6 +4,7 @@
 
 | Commit | Committed | Subject |
 |:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
 | [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
 | [f4edd90a9](https://github.com/apache/airflow/commit/f4edd90a94b8f91bbefbbbfba367372399559596) | 2020-05-16 | Speed up TestAwsLambdaHook by not actually running a function (#8882) |
 | [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |

diff --git a/airflow/providers/amazon/README.md b/airflow/providers/amazon/README.md
@@ -51,6 +51,13 @@ Release: 2020.5.20
 This is a backport providers package for `amazon` provider. All classes for this provider package
 are in `airflow.providers.amazon` python package.
 
+**Only Python 3.6+ is supported for this backport package.**
+
+While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
+want to use this backport package.
+
+
+
 ## Installation
 
 You can install this package on top of an existing airflow 1.10.* installation via
@@ -249,6 +256,7 @@ All classes in Airflow 2.0 are in `airflow.providers.amazon` package.
 
 | Commit | Committed | Subject |
 |:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
 | [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
 | [f4edd90a9](https://github.com/apache/airflow/commit/f4edd90a94b8f91bbefbbbfba367372399559596) | 2020-05-16 | Speed up TestAwsLambdaHook by not actually running a function (#8882) |
 | [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |

diff --git a/airflow/providers/apache/cassandra/PROVIDERS_CHANGES_2020.05.20.md b/airflow/providers/apache/cassandra/PROVIDERS_CHANGES_2020.05.20.md
@@ -4,6 +4,7 @@
 
 | Commit | Committed | Subject |
 |:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------|
+| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
 | [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
 | [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
 | [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |

diff --git a/airflow/providers/apache/cassandra/README.md b/airflow/providers/apache/cassandra/README.md
@@ -41,6 +41,13 @@ Release: 2020.5.20
 This is a backport providers package for `apache.cassandra` provider. All classes for this provider package
 are in `airflow.providers.apache.cassandra` python package.
 
+**Only Python 3.6+ is supported for this backport package.**
+
+While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
+want to use this backport package.
+
+
+
 ## Installation
 
 You can install this package on top of an existing airflow 1.10.* installation via
@@ -98,6 +105,7 @@ All classes in Airflow 2.0 are in `airflow.providers.apache.cassandra` package.
 
 | Commit | Committed | Subject |
 |:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------|
+| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
 | [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
 | [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
 | [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |

diff --git a/airflow/providers/apache/druid/PROVIDERS_CHANGES_2020.05.20.md b/airflow/providers/apache/druid/PROVIDERS_CHANGES_2020.05.20.md
@@ -4,6 +4,7 @@
 
 | Commit | Committed | Subject |
 |:-----------------------------------------------------------------------------------------------|:------------|:--------------------------------------------------------------------------------------------|
+| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
 | [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
 | [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
 | [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |

diff --git a/airflow/providers/apache/druid/README.md b/airflow/providers/apache/druid/README.md
@@ -42,6 +42,13 @@ Release: 2020.5.20
 This is a backport providers package for `apache.druid` provider. All classes for this provider package
 are in `airflow.providers.apache.druid` python package.
 
+**Only Python 3.6+ is supported for this backport package.**
+
+While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
+want to use this backport package.
+
+
+
 ## Installation
 
 You can install this package on top of an existing airflow 1.10.* installation via
@@ -117,6 +124,7 @@ All classes in Airflow 2.0 are in `airflow.providers.apache.druid` package.
 
 | Commit | Committed | Subject |
 |:-----------------------------------------------------------------------------------------------|:------------|:--------------------------------------------------------------------------------------------|
+| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
 | [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
 | [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
 | [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |

diff --git a/airflow/providers/apache/hdfs/PROVIDERS_CHANGES_2020.05.20.md b/airflow/providers/apache/hdfs/PROVIDERS_CHANGES_2020.05.20.md
@@ -4,6 +4,7 @@
 
 | Commit | Committed | Subject |
 |:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
+| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
 | [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
 | [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
 | [87969a350](https://github.com/apache/airflow/commit/87969a350ddd41e9e77776af6d780b31e363eaca) | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |

diff --git a/airflow/providers/apache/hdfs/README.md b/airflow/providers/apache/hdfs/README.md
@@ -41,6 +41,13 @@ Release: 2020.5.20
 This is a backport providers package for `apache.hdfs` provider. All classes for this provider package
 are in `airflow.providers.apache.hdfs` python package.
 
+**Only Python 3.6+ is supported for this backport package.**
+
+While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
+want to use this backport package.
+
+
+
 ## Installation
 
 You can install this package on top of an existing airflow 1.10.* installation via
@@ -101,6 +108,7 @@ All classes in Airflow 2.0 are in `airflow.providers.apache.hdfs` package.
 
 | Commit | Committed | Subject |
 |:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
+| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
 | [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
 | [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
 | [87969a350](https://github.com/apache/airflow/commit/87969a350ddd41e9e77776af6d780b31e363eaca) | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |

diff --git a/airflow/providers/apache/hive/PROVIDERS_CHANGES_2020.05.20.md b/airflow/providers/apache/hive/PROVIDERS_CHANGES_2020.05.20.md
@@ -4,6 +4,7 @@
 
 | Commit | Committed | Subject |
 |:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
 | [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
 | [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
 | [93ea05880](https://github.com/apache/airflow/commit/93ea05880283a56e3d42ab07db7453977a3de8ec) | 2020-04-21 | [AIRFLOW-7059] pass hive_conf to get_pandas_df in HiveServer2Hook (#8380) |