Skip to content

2018-12-20 (GCS 1.9.11, BQ 0.13.11)

Compare
Choose a tag to compare
@functicons functicons released this 20 Dec 21:50
· 812 commits to master since this release

Changelog

Cloud Storage connector:

  1. Changed the default value of fs.gs.path.encoding to 'uri-path', the new codec introduced in 1.4.5. The old behavior can be restored by setting fs.gs.path.encoding to 'legacy'.

  2. Update all dependencies to latest versions.

  3. Don't use fs.gs.performance.cache.dir.metadata.prefetch.limit property to prefetch metadata in PerformanceCachingGoogleCloudStorage - always use single objects list request, because prefetching metadata with multiple list requests (when directory contains a lot of files) could introduce performance penalties when using performance cache.

  4. Add an option to lazily initialize GoogleHadoopFileSystem instances:

    fs.gs.lazy.init.enable (default: false)
    
  5. Add ability to unset fs.gs.system.bucket with an empty string value:

    fs.gs.system.bucket=
    
  6. Set default value for fs.gs.working.dir property to /.

BigQuery connector:

  1. POM updates for GCS connector 1.9.11.
  2. Update all dependencies to latest versions.