Preserve ASCII control characters directly through the BigQuery load …

…API (#36533) * Update gcs_to_bigquery.py There is now the option to preserve ASCII control characters directly through the BQ load API. Add in this option * add comma --------- Co-authored-by: Zili Ge <[email protected]>
apache · Jan 3, 2024 · 75aa4a3 · 75aa4a3
1 parent 18b7013
commit 75aa4a3
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/airflow/providers/google/cloud/transfers/gcs_to_bigquery.py b/airflow/providers/google/cloud/transfers/gcs_to_bigquery.py
@@ -657,6 +657,7 @@ def _use_existing_table(self):
  "nullMarker",
  "quote",
  "encoding",
+ "preserveAsciiControlCharacters",
  ],
  "DATASTORE_BACKUP": ["projectionFields"],
  "NEWLINE_DELIMITED_JSON": ["autodetect", "ignoreUnknownValues"],