PyPI Stats

Dataengineering Python Packages

Python packages with the GitHub topic dataengineering. Sorted by relevance, with stars and monthly downloads.
datafold
collate-data-diff

Compare tables within or across databases

939K 3K 305
SQLMesh
sqlmesh

Scalable and efficient data transformation framework - backwards compatible with dbt.

502K 3K 380
open-metadata
openmetadata-ingestion

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

391K 14K 2K
datafold
data-diff

Compare tables within or across databases

56K 3K 305
open-metadata
openmetadata-managed-apis

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

39K 14K 2K
zinggAI
zingg

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

5K 1K 165
open-metadata
openmetadata-airflow-managed-apis

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

3K 14K 2K
awslabs
aws-ddk-core

An open source development framework to help you build data workflows and modern data architecture on AWS.

3K 271 24
grai-io
grai-client

No description available

2K 314 20
grai-io
grai-schemas

No description available

2K 314 20
grai-io
grai-source-dbt

No description available

2K 314 20
awslabs
aws-orbit-overprovisioning

A Data Platform built for AWS, powered by Kubernetes.

2K 147 92
afogarty85
camelcasing

Official repository for the camelCasing package

2K 2 0
grai-io
grai-source-bigquery

No description available

1K 314 20
grai-io
grai-source-snowflake

No description available

1K 314 20
grai-io
grai-source-postgres

No description available

1K 314 20
prodmodel
prodmodel

Build, test, deploy, iterate - Dev and prod tool for data science pipelines

1K 58 3
open-metadata
openmetadata-ingestion-core

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

1K 14K 2K
grai-io
grai-graph

No description available

1K 314 20
grai-io
grai-cli

No description available

1K 314 20
grai-io
grai-source-mssql

No description available

1K 314 20
fvaleye
metadata-guardian

Provide an easy way with Python to protect your data sources by searching its metadata. 🛡️

934 18 1
grai-io
grai-source-mysql

No description available

924 314 20
awslabs
aws-orbit

A Data Platform built for AWS, powered by Kubernetes.

921 147 92