Dataframe Python Packages

snowflake-snowpark-python

Snowflake Snowpark Python API

polars

Extremely fast Query Engine for DataFrames, written in Rust

polars-runtime-32

Extremely fast Query Engine for DataFrames, written in Rust

graphframes

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

modin

Modin: Scale your Pandas workflows by changing a single line of code

mimesis

Mimesis is a fast Python library for generating fake data in multiple languages.

koalas

Koalas: pandas API on Apache Spark

connectorx

Fastest library to load data from DB to DataFrames in Rust and Python

graphframes-py

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

polars-lts-cpu

Extremely fast Query Engine for DataFrames, written in Rust

pyjanitor

Clean APIs for data cleaning. Python implementation of R package Janitor

awkward-pandas

For when your data won't fit in your dataframe

pyspark-test

Testing library for pyspark, inspired from pandas testing module but for pyspark, to help users write unit tests.

pygwalker

PyGWalker: Turn your dataframe into an interactive UI for visual analysis

arcticdb

ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem.

pbspark

protobuf pyspark conversion

libcudf-cu12

cuDF - GPU DataFrame Library

pylibcudf-cu12

cuDF - GPU DataFrame Library

skrub

Machine learning with dataframes

cudf-cu12

cuDF - GPU DataFrame Library

technical

Various indicators developed or collected for the Freqtrade

sf-hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

polars-runtime-compat

Extremely fast Query Engine for DataFrames, written in Rust

woodwork

Woodwork is a Python library that provides robust methods for managing and communicating data typing information.