Data Wrangling Python Packages

skrub

Machine learning with dataframes

optimuspyspark

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

desbordante

Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

omnipy

Omnipy is a high level Python library for type-driven data wrangling and scalable workflow orchestration (under development)

whyqd

data wrangling simplicity, complete audit transparency, and at speed

hypertools

A python package for visualizing and manipulating high-dimensional data

datagrunt

Datagrunt is a Python library designed to simplify the way you work with CSV files. It provides a streamlined approach to reading, processing, and transforming your data into various formats, making data manipulation efficient and intuitive.

data-toolz

simple python library for handling data-io tasks

pyoptimus

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

anonymized-fraud-detection

A small package to parse and train an ML model for anonymized credit card transactions. Refer to github wikis for more details. Package was built for PythonVirtualenvOperator() on GCP Airflow.

monggregate

MongoDB aggregation pipelines made easy. Joins, grouping, counting and much more...

csv-trimming

Package python to remove common ugliness from a csv-like file

pydata-wrangler

Wrangle messy data into DataFrames (pandas or Polars), with a special focus on text data and natural language processing

skloverlay

This repository is the official location of the SKLOverlay Project. Here, it will hold everything used for the package on Py Pi, including source files.

datasetops

Fluent dataset operations, compatible with your favorite libraries

loclean

High-performance, local-first semantic data cleaning library

prosto

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

excel-toolkit-cwd

Command-line toolkit for Excel data manipulation and analysis

ics-fixer

Fix slightly broken iCalendar files

databroom

A cross-language DataFrame cleaning assistant with interactive GUI and one-click code export

gis-conflation-toolchain

[EARLY-DRAFT] See geojson-diff.py from https://github.com/fititnt/openstreetmap-vs-dados-abertos-brasil

pandance

Advanced relational operations for pandas DataFrames

data-cleaning

Data Cleaning is a python package for data preprocessing. This cleans the CSV file and returns the cleaned data frame. It does the work of imputation, removing duplicates, replacing special characters, and many more.

panda-grove

A lightweight package to manage multiple Pandas DataFrame