Skip to content
This repository has been archived by the owner on Jul 13, 2023. It is now read-only.

Delta Connectors 0.2.0
Compare
Choose a tag to compare
@zsxwing zsxwing released this 10 Dec 04:39
· 246 commits to master since this release
v0.2.0
e7004ad
This commit was signed with the committer’s verified signature. The key has expired.
zsxwing Shixiong Zhu
GPG key ID: 00CC7E88AC5A8A94
Expired
Learn about vigilant mode.

We are excited to announce the availability of the Delta Connectors 0.2.0.

In this release, we have added the Delta Standalone Reader, which provides a Java API to access Delta Lake transaction logs and data without Apache Spark. It can be used to read Delta tables in JVM applications, or build Delta connectors for query engines.

The Hive Connector has now been rewritten using Delta Standalone Reader and doesn’t use the embedded Spark. This reduces the size of the JAR package (from about 90MB to less than 20MB) as well as the memory-consumption of the connector in most cases.

For details, see README.

Credits
Scott Sandre, Allen Reese, Luca Menichetti, Shixiong Zhu.

Special thanks to Jun Song from Alibaba Inc. His delta-thin project inspired the Delta Standalone Reader project.

Thank you for your contributions.

Assets 6