Data Python Packages

pooch

A friend to fetch your data files

glom

☄️ Python's nested data operator (and CLI), for all your declarative restructuring needs. Got data? Glom it! ☄️

prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

pypika

PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.

llama-index

LlamaIndex is the leading document agent and OCR platform

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

llama-index-core

LlamaIndex is the leading document agent and OCR platform

prefect-aws

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

llama-index-instrumentation

LlamaIndex is the leading document agent and OCR platform

dataproperty

A Python library for extract property from data.

akshare

AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库

datacompy

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

dvc-data

DVC's data management subsystem

mimesis

Mimesis is a fast Python library for generating fake data in multiple languages.

prefect-docker

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

tensorflow-datasets

TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...

tentaclio

Single repository regrouping IO connectors used in the data world.

mcap

MCAP is a modular, performant, and serialization-agnostic container file format, useful for pub/sub and robotics applications.

prefect-dbt

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

prefect-gcp

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

meltano

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

pytest-cases

Separate test code from test cases in pytest.

collate-data-diff

Compare tables within or across databases

prefect-sqlalchemy

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.