Data Lake Python Packages

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

lakefs-sdk

lakeFS - Data version control for your data lake | Git for data

lakefs

lakeFS - Data version control for your data lake | Git for data

lakefs-client

lakeFS - Data version control for your data lake | Git for data

aligned

The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt

dlt-cratedb

dlt destination adapter for CrateDB

nodestream

A Declarative framework for Building, Maintaining, and Analyzing Graph Data

wren-core-py

The open context engine for AI agents support 15+ data sources. Built on Rust and Apache DataFusion.

wren-engine

The open context engine for AI agents support 15+ data sources. Built on Rust and Apache DataFusion.

dlt-core

dlt is an open-source python-first scalable data loading library that does not require any backend to run.

timeseries-table-format

Append-only time-series table format with gap/overlap tracking (Python bindings).

nodestream-plugin-dotenv

A plugin to nodestream for loading environment variables from a .env file

lakexpress-mcp

A Model Context Protocol (MCP) server for LakeXpress, enabling database to Parquet export with sync management and data lake publishing.

nodestream-plugin-meta

A plugin to nodestream for building a graph of the schema of the graph.

nodestream-plugin-semantic

A plugin for embedding semantic data into a nodestream project

virtual-parquet

🗜️Compressing Parquet files using functions (TRL @NeurIPS'24, EDBT Best Demo'25)

nodestream-plugin-pedantic

A nodestream plugin that provides a series of audits to ensure high quality and consistent nodestream projects.

lakefs-sdk-async

lakeFS - Data version control for your data lake | Git for data

etlx-wrapper

Python wrapper for ETLX CLI to run ETL workflows from Python

vulcan-sql

Data API Framework for AI Agents and Data Apps

ztract

Extract mainframe EBCDIC data using COBOL copybooks. Zero MIPS. Pure Python + Cobrix engine.

dlt-dataops

dlt is an open-source python-first scalable data loading library that does not require any backend to run.