Data Lineage Python Packages

sqllineage

SQL Lineage Analysis Tool powered by Python

elementary-data

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

openmetadata-ingestion

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

lamindb

Open-source data framework for biology. Context and memory for datasets and models at scale. Query, trace & validate with a lineage-native lakehouse that supports bio-formats, registries & ontologies. 🍊YC S22

openmetadata-managed-apis

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

quickstart-vdk

One framework to develop, deploy and operate data workflows with Python and SQL.

datajoint

Relational data pipelines for the science lab

lamindb-core

Open-source data framework for biology. Context and memory for datasets and models at scale. Query, trace & validate with a lineage-native lakehouse that supports bio-formats, registries & ontologies. 🍊YC S22

dagster-rocky

The trust system for your data. Rust-based control plane for warehouse pipelines — branches, replay, column-level lineage, compile-time safety, per-model cost attribution. Keep Databricks or Snowflake. Bring Rocky for the DAG.

vdk-core

One framework to develop, deploy and operate data workflows with Python and SQL.

openmetadata-airflow-managed-apis

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

openblame

Local-first AI investigation CLI for OpenMetadata data pipelines.

grai-client

No description available

driftdb

Historical metric store

grai-schemas

No description available

vdk-jupyterlab-extension

One framework to develop, deploy and operate data workflows with Python and SQL.

grai-source-dbt

No description available

raglineage

Lineage-aware RAG engine for auditable, reproducible, versioned retrieval and answers

autolineage

Automatic ML data lineage tracking — zero manual logging

grai-source-bigquery

No description available

grai-source-snowflake

No description available

vdk-control-cli

VDK Control CLI allows user to create, delete, manage and their Data Jobs in Kubernetes runtime.

grai-source-postgres

No description available

datagit

Metrics Observability & Troubleshooting