2018-12-20 (GCS 1.9.11, BQ 0.13.11)
Changelog
Cloud Storage connector:
-
Changed the default value of
fs.gs.path.encoding
to 'uri-path', the new codec introduced in 1.4.5. The old behavior can be restored by settingfs.gs.path.encoding
to 'legacy'. -
Update all dependencies to latest versions.
-
Don't use
fs.gs.performance.cache.dir.metadata.prefetch.limit
property to prefetch metadata inPerformanceCachingGoogleCloudStorage
- always use single objects list request, because prefetching metadata with multiple list requests (when directory contains a lot of files) could introduce performance penalties when using performance cache. -
Add an option to lazily initialize
GoogleHadoopFileSystem
instances:fs.gs.lazy.init.enable (default: false)
-
Add ability to unset
fs.gs.system.bucket
with an empty string value:fs.gs.system.bucket=
-
Set default value for
fs.gs.working.dir
property to/
.
BigQuery connector:
- POM updates for GCS connector 1.9.11.
- Update all dependencies to latest versions.