Bump common.sql provider to 1.3.1 (#27888)

The common.sql provider should be bumped to 1.3.1 in order to handle some of the problems found in 1.3.0 - mainly about consistency of common SQLExecuteQueryOperator that is used in multiple providers. We are going to yank 1.3.0 - this PR also bumps min dependency for all providers that use common.sql to make sure we can release them in sync with the common.sql provider.
apache · Nov 24, 2022 · 80c327b · 80c327b
1 parent 485142a
commit 80c327b
Show file tree

Hide file tree

Showing 27 changed files with 80 additions and 46 deletions.
diff --git a/airflow/providers/amazon/provider.yaml b/airflow/providers/amazon/provider.yaml
@@ -48,7 +48,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - boto3>=1.24.0
  # watchtower 3 has been released end Jan and introduced breaking change across the board that might
  # change logging behaviour:

diff --git a/airflow/providers/apache/drill/provider.yaml b/airflow/providers/apache/drill/provider.yaml
@@ -35,7 +35,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - sqlalchemy-drill>=1.1.0
 
 integrations:

diff --git a/airflow/providers/apache/druid/provider.yaml b/airflow/providers/apache/druid/provider.yaml
@@ -42,7 +42,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - pydruid>=0.4.1
 
 integrations:

diff --git a/airflow/providers/apache/hive/provider.yaml b/airflow/providers/apache/hive/provider.yaml
@@ -44,7 +44,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - hmsclient>=0.1.0
  - pandas>=0.17.1
  - pyhive[hive]>=0.6.0

diff --git a/airflow/providers/apache/pinot/provider.yaml b/airflow/providers/apache/pinot/provider.yaml
@@ -37,7 +37,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - pinotdb>0.4.7
 
 integrations:

diff --git a/airflow/providers/common/sql/CHANGELOG.rst b/airflow/providers/common/sql/CHANGELOG.rst
@@ -24,6 +24,26 @@
 Changelog
 ---------
 
+1.3.1
+.....
+
+This release fixes a few errors that were introduced in common.sql operator while refactoring common parts:
+
+* ``_process_output`` method in ``SQLExecuteQueryOperator`` has now consistent semantics and typing, it
+ can also modify the returned (and stored in XCom) values in the operators that derive from the
+ ``SQLExecuteQueryOperator``).
+* last description of the cursor whether to return scalar values are now stored in DBApiHook
+
+Lack of consistency in the operator caused ``1.3.0`` to be yanked - the ``1.3.0`` should not be used - if
+you have ``1.3.0`` installed, upgrade to ``1.3.1``.
+
+Bug Fixes
+~~~~~~~~~
+
+* ``Restore removed (but used) methods in common.sql (#27843)``
+* ``Fix errors in Databricks SQL operator introduced when refactoring (#27854)``
+
+
 1.3.0
 .....
 

diff --git a/airflow/providers/common/sql/provider.yaml b/airflow/providers/common/sql/provider.yaml
@@ -22,6 +22,7 @@ description: |
  `Common SQL Provider <https://en.wikipedia.org/wiki/SQL>`__
 
 versions:
+ - 1.3.1
  - 1.3.0
  - 1.2.0
  - 1.1.0

diff --git a/airflow/providers/databricks/provider.yaml b/airflow/providers/databricks/provider.yaml
@@ -42,7 +42,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - requests>=2.27,<3
  - databricks-sql-connector>=2.0.0, <3.0.0
  - aiohttp>=3.6.3, <4

diff --git a/airflow/providers/elasticsearch/provider.yaml b/airflow/providers/elasticsearch/provider.yaml
@@ -44,7 +44,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - elasticsearch>7
  - elasticsearch-dbapi
  - elasticsearch-dsl>=5.0.0

diff --git a/airflow/providers/exasol/provider.yaml b/airflow/providers/exasol/provider.yaml
@@ -39,7 +39,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - pyexasol>=0.5.1
  - pandas>=0.17.1
 

diff --git a/airflow/providers/google/provider.yaml b/airflow/providers/google/provider.yaml
@@ -56,7 +56,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  # Google has very clear rules on what dependencies should be used. All the limits below
  # follow strict guidelines of Google Libraries as quoted here:
  # While this issue is open, dependents of google-api-core, google-cloud-core. and google-auth

diff --git a/airflow/providers/jdbc/provider.yaml b/airflow/providers/jdbc/provider.yaml
@@ -38,7 +38,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - jaydebeapi>=1.1.1
 
 integrations:

diff --git a/airflow/providers/microsoft/mssql/provider.yaml b/airflow/providers/microsoft/mssql/provider.yaml
@@ -39,7 +39,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - pymssql>=2.1.5; platform_machine != "aarch64"
 
 integrations:

diff --git a/airflow/providers/mysql/provider.yaml b/airflow/providers/mysql/provider.yaml
@@ -41,7 +41,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - mysql-connector-python>=8.0.11; platform_machine != "aarch64"
  - mysqlclient>=1.3.6; platform_machine != "aarch64"
 

diff --git a/airflow/providers/odbc/provider.yaml b/airflow/providers/odbc/provider.yaml
@@ -37,7 +37,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - pyodbc
 
 integrations:

diff --git a/airflow/providers/oracle/provider.yaml b/airflow/providers/oracle/provider.yaml
@@ -41,7 +41,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - oracledb>=1.0.0
 
 integrations:

diff --git a/airflow/providers/postgres/provider.yaml b/airflow/providers/postgres/provider.yaml
@@ -43,7 +43,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - psycopg2>=2.8.0
 
 integrations:

diff --git a/airflow/providers/presto/provider.yaml b/airflow/providers/presto/provider.yaml
@@ -40,7 +40,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - presto-python-client>=0.8.2
  - pandas>=0.17.1
 

diff --git a/airflow/providers/qubole/provider.yaml b/airflow/providers/qubole/provider.yaml
@@ -39,7 +39,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - qds-sdk>=1.10.4
 
 integrations:

diff --git a/airflow/providers/slack/provider.yaml b/airflow/providers/slack/provider.yaml
@@ -39,7 +39,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - slack_sdk>=3.0.0
 
 integrations:

diff --git a/airflow/providers/snowflake/provider.yaml b/airflow/providers/snowflake/provider.yaml
@@ -47,7 +47,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - snowflake-connector-python>=2.4.1
  - snowflake-sqlalchemy>=1.1.0
 

diff --git a/airflow/providers/sqlite/provider.yaml b/airflow/providers/sqlite/provider.yaml
@@ -38,7 +38,7 @@ versions:
  - 1.0.0
 
 dependencies:
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
 
 integrations:
  - integration-name: SQLite

diff --git a/airflow/providers/trino/provider.yaml b/airflow/providers/trino/provider.yaml
@@ -40,7 +40,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - pandas>=0.17.1
  - trino>=0.318.0
 

diff --git a/airflow/providers/vertica/provider.yaml b/airflow/providers/vertica/provider.yaml
@@ -38,7 +38,7 @@ versions:
 
 dependencies:
  - apache-airflow>=2.3.0
- - apache-airflow-providers-common-sql>=1.3.0
+ - apache-airflow-providers-common-sql>=1.3.1
  - vertica-python>=0.5.1
 
 integrations:

diff --git a/docs/apache-airflow-providers-common-sql/commits.rst b/docs/apache-airflow-providers-common-sql/commits.rst
@@ -28,14 +28,27 @@ For high-level changelog, see :doc:`package information including changelog <ind
 
 
 
+1.4.0
+.....
+
+Latest change: 2022-11-24
+
+================================================================================================= =========== ==============================================================================
+Commit Committed Subject
+================================================================================================= =========== ==============================================================================
+`ea306c9462 <https://github.com/apache/airflow/commit/ea306c9462615d6b215d43f7f17d68f4c62951b1>`_ 2022-11-24 ``Fix errors in Databricks SQL operator introduced when refactoring (#27854)``
+`dbb4b59dcb <https://github.com/apache/airflow/commit/dbb4b59dcbc8b57243d1588d45a4d2717c3e7758>`_ 2022-11-23 ``Restore removed (but used) methods in common.sql (#27843)``
+================================================================================================= =========== ==============================================================================
+
 1.3.0
 .....
 
-Latest change: 2022-11-14
+Latest change: 2022-11-15
 
 ================================================================================================= =========== ====================================================================================
 Commit Committed Subject
 ================================================================================================= =========== ====================================================================================
+`12c3c39d1a <https://github.com/apache/airflow/commit/12c3c39d1a816c99c626fe4c650e88cf7b1cc1bc>`_ 2022-11-15 ``pRepare docs for November 2022 wave of Providers (#27613)``
 `3ae98b824d <https://github.com/apache/airflow/commit/3ae98b824db437b2db928a73ac8b50c0a2f80124>`_ 2022-11-14 ``Use unused SQLCheckOperator.parameters in SQLCheckOperator.execute. (#27599)``
 `5c37b503f1 <https://github.com/apache/airflow/commit/5c37b503f118b8ad2585dff9949dd8fdb96689ed>`_ 2022-10-31 ``Use DbApiHook.run for DbApiHook.get_records and DbApiHook.get_first (#26944)``
 `9ab1a6a3e7 <https://github.com/apache/airflow/commit/9ab1a6a3e70b32a3cddddf0adede5d2f3f7e29ea>`_ 2022-10-27 ``Update old style typing (#26872)``

diff --git a/docs/apache-airflow-providers-common-sql/index.rst b/docs/apache-airflow-providers-common-sql/index.rst
@@ -64,7 +64,7 @@ Package apache-airflow-providers-common-sql
 `Common SQL Provider <https://en.wikipedia.org/wiki/SQL>`__
 
 
-Release: 1.3.0
+Release: 1.4.0
 
 Provider package
 ----------------