Skip to main content
Version: Next

DataHub Releases

Summary​

VersionRelease DateLinks
v0.13.02024-02-29Release Notes, View on GitHub
v0.12.12023-12-08Release Notes, View on GitHub
v0.12.02023-10-25View on GitHub
v0.11.02023-09-08View on GitHub
v0.10.52023-08-02View on GitHub
v0.10.42023-06-09View on GitHub
v0.10.32023-05-25View on GitHub
v0.10.22023-04-13View on GitHub
v0.10.12023-03-23View on GitHub
v0.10.02023-02-07View on GitHub
v0.9.6.12023-01-31View on GitHub
v0.9.62023-01-13View on GitHub
v0.9.52022-12-23View on GitHub
v0.9.42022-12-20View on GitHub
v0.9.32022-11-30View on GitHub
v0.9.22022-11-04View on GitHub
v0.9.12022-10-31View on GitHub
v0.9.02022-10-11View on GitHub
v0.8.452022-09-23View on GitHub
v0.8.442022-09-01View on GitHub
v0.8.432022-08-09View on GitHub
v0.8.422022-08-03View on GitHub
v0.8.412022-07-15View on GitHub
v0.8.402022-06-30View on GitHub
v0.8.392022-06-24View on GitHub
v0.8.382022-06-09View on GitHub
v0.8.372022-06-09View on GitHub
v0.8.362022-06-02View on GitHub
v0.8.352022-05-18View on GitHub

v0.13.0​

Released on 2024-02-29 by @RyanHolstien.

Breaking Changes​

Updating MySQL version for quickstarts to 8.2, may cause quickstart issues for existing instances.

Neo4j 5.x, may require migration from 4.x

Build requires JDK17 (Runtime Java 11)

Build requires Docker Compose > 2.20

#9731 - The acryl-datahub CLI now requires Python 3.8+

#9601 - The Unity Catalog(UC) ingestion source config include_metastore is now disabled by default. This change will affect the urns of all entities in the workspace. Entity Hierarchy with include_metastore: true (Old)

  • UC Metastore

    • Catalog
      - Schema
        - Table
      Entity Hierarchy with include_metastore: false (New)

  • Catalog

    • Schema
      - Table
      We recommend using platform_instance for differentiating across metastores.

If stateful ingestion is enabled, running ingestion with latest cli version will perform all required cleanup. Otherwise, we recommend soft deleting all databricks data via the DataHub CLI: datahub delete --platform databricks --soft and then reingesting with latest cli version.

#9601 - The Unity Catalog(UC) ingestion source config include_hive_metastore is now enabled by default. This requires config warehouse_id to be set. You can disable include_hive_metastore by setting it to False to avoid ingesting legacy hive metastore catalog in Databricks.

#9904 - The default Redshift table_lineage_mode is now MIXED, instead of STL_SCAN_BASED. Improved lineage generation is also available by enabling use_lineaege_v2. This v2 implementation will become the default in a future release.

Deprecations​

Spark 2.x (including previous JDK8 build requirements)

What's Changed​

New Contributors​

Full Changelog: https://github.com/datahub-project/datahub/compare/v0.12.1...v0.13.0

DataHub v0.12.1​

Released on 2023-12-08 by @david-leifker.

Release Highlights​

New Features​

SQLAlchemy Source Enhancements: Support for view lineage across all SQLAlchemy sources (PR #9039). Airflow Integration: Retry callback and support for ExternalTaskSensor subclasses added (PR #8514). Kafka Enhancements: Increased Kafka message size and enabled compression (PR #9038). JSONSchema Ingestion: Enabled schema-aware JsonSchemaTranslator (PR #8971). Search Bar Improvements: Added a flag to hide/display the autocomplete query (PR #9104). SQL Parser Performance: Enhancements and asyncio fixes (PR #9119). MongoDB Ingestion: Support for stateful ingestion and improved schema inference for lists (PR #9118, PR #9145). Policy Engine Updates: Refactoring and enhancements, including support for 10k+ policies (PR #9163, PR #9177). UI Enhancements: Numerous improvements including command-k icons in the search bar, updated Apollo cache, and auto-complete debounce in the search bar (PR #9194, PR #9193, PR #9205). Fivetran Integration: Connector integration for Fivetran (PR #9018). Neo4j Database Support: Connection to specific Neo4j databases now supported (PR #9179). Chart Subtypes in UI: Support for chart subtypes (PR #9186).

Fixes and Improvements​

BigQuery Fixes: Resolved issues with lineage filter query, and fixed extracting comments from complex types (PR #9114, PR #8950). MongoDB Refactoring: Platform instance addition to MongoDB (PR #8663). Kafka Setup: Adjusted truststore settings for PEM files (PR #8656). REST API Authorization: Fixed rollback failure when authorization is enabled (PR #9092). Java Exception Handling: Addressed java.util.ConcurrentModificationException (PR #9090). UI and Documentation: Fixed filtering logic in UI, corrected documentation errors, and added feature guides (PR #9116, PR #9125, PR #9124, PR #9126, PR #9134, PR #9137, PR #9122, PR #9068). SQL Server and Snowflake Ingestion: Updated queries and fixed missing view downstream call (PR #9127, PR #8966). ClickHouse and DB2 Ingestion: Addressed column reflection regression and table properties handling (PR #9143, PR #9128). Ingestion Improvements: Numerous fixes and enhancements across various ingestion sources (PR #9153, PR #9155, PR #9141, PR #9157, PR #9123). CI and Build Process: Tweaked workflows, increased gradle retries, and addressed CI errors (PR #9052, PR #9091, PR #9160). Security Updates: Addressed a zookeeper CVE and other security concerns (PR #9190). UI Refactoring: Improved entity page loading indicators and renamed button texts (PR #9195, PR #9196). Policy and Auth Enhancements: Refactored policy locking and added roles to policy engine validation logic (PR #9178).

Testing and Continuous Integration​

API Testing: Added tests for managing secrets, access token privilege, and flaky tests fix (PR #9121, PR #9167, PR #9132, PR #9175). Cypress Test Fixes: Addressed glossary navigation and download_lineage_results tests (PR #9175, PR #9132). Cleanup and Refactoring Ingestion Cleanup: Removed legacy memory_leak_detector and refactored ingestion sources (PR #9158, PR #9135, PR #9120, PR #9105). PDL Refactoring: Refactored Assertion model enums (PR #9191). Build and Deployment Release Preparation: Updated files for the 0.12.0 release (PR #9130).

What's Changed​

New Contributors​

Full Changelog: https://github.com/datahub-project/datahub/compare/v0.12.0...v0.12.1

v0.12.1rc2​

Released on 2023-11-28 by @david-leifker.

View the release notes for v0.12.1rc2 on GitHub.

v0.12.0​

Released on 2023-10-25 by @pedro93.

View the release notes for v0.12.0 on GitHub.

v0.11.0​

Released on 2023-09-08 by @iprentic.

View the release notes for v0.11.0 on GitHub.

v0.10.5​

Released on 2023-08-02 by @david-leifker.

View the release notes for v0.10.5 on GitHub.

v0.10.4​

Released on 2023-06-09 by @pedro93.

View the release notes for v0.10.4 on GitHub.

v0.10.3​

Released on 2023-05-25 by @iprentic.

View the release notes for v0.10.3 on GitHub.

DataHub v0.10.2​

Released on 2023-04-13 by @iprentic.

View the release notes for DataHub v0.10.2 on GitHub.

DataHub v0.10.1​

Released on 2023-03-23 by @aditya-radhakrishnan.

View the release notes for DataHub v0.10.1 on GitHub.

DataHub v0.10.0​

Released on 2023-02-07 by @david-leifker.

View the release notes for DataHub v0.10.0 on GitHub.

DataHub v0.9.6.1​

Released on 2023-01-31 by @david-leifker.

View the release notes for DataHub v0.9.6.1 on GitHub.

DataHub v0.9.6​

Released on 2023-01-13 by @maggiehays.

View the release notes for DataHub v0.9.6 on GitHub.

DataHub v0.9.5​

Released on 2022-12-23 by @jjoyce0510.

View the release notes for DataHub v0.9.5 on GitHub.

[Known Issues] DataHub v0.9.4​

Released on 2022-12-20 by @maggiehays.

View the release notes for [Known Issues] DataHub v0.9.4 on GitHub.

DataHub v0.9.3​

Released on 2022-11-30 by @maggiehays.

View the release notes for DataHub v0.9.3 on GitHub.

DataHub v0.9.2​

Released on 2022-11-04 by @maggiehays.

View the release notes for DataHub v0.9.2 on GitHub.

DataHub v0.9.1​

Released on 2022-10-31 by @maggiehays.

View the release notes for DataHub v0.9.1 on GitHub.

DataHub v0.9.0​

Released on 2022-10-11 by @szalai1.

View the release notes for DataHub v0.9.0 on GitHub.

DataHub v0.8.45​

Released on 2022-09-23 by @gabe-lyons.

View the release notes for DataHub v0.8.45 on GitHub.

DataHub v0.8.44​

Released on 2022-09-01 by @jjoyce0510.

View the release notes for DataHub v0.8.44 on GitHub.

DataHub v0.8.43​

Released on 2022-08-09 by @maggiehays.

View the release notes for DataHub v0.8.43 on GitHub.

v0.8.42​

Released on 2022-08-03 by @gabe-lyons.

View the release notes for v0.8.42 on GitHub.

v0.8.41​

Released on 2022-07-15 by @anshbansal.

View the release notes for v0.8.41 on GitHub.

v0.8.40​

Released on 2022-06-30 by @gabe-lyons.

View the release notes for v0.8.40 on GitHub.

v0.8.39​

Released on 2022-06-24 by @maggiehays.

View the release notes for v0.8.39 on GitHub.

[!] DataHub v0.8.38​

Released on 2022-06-09 by @jjoyce0510.

View the release notes for [!] DataHub v0.8.38 on GitHub.

[!] DataHub v0.8.37​

Released on 2022-06-09 by @jjoyce0510.

View the release notes for [!] DataHub v0.8.37 on GitHub.

DataHub V0.8.36​

Released on 2022-06-02 by @treff7es.

View the release notes for DataHub V0.8.36 on GitHub.

[!] DataHub v0.8.35​

Released on 2022-05-18 by @dexter-mh-lee.

View the release notes for [!] DataHub v0.8.35 on GitHub.