Dask Python Packages

narwhals

Lightweight and extensible compatibility layer between dataframe libraries!

dask

Parallel computing with task scheduling

xarray

N-D labeled arrays and datasets in Python

distributed

A distributed task scheduler for Dask

swifter

A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

fugue

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

datacompy

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

array-api-compat

Compatibility layer for common array libraries to support the Array API

fugue-sql-antlr

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

mlforecast

Scalable machine 🤖 learning for time series forecasting.

autoray

Abstract your array operations.

xgboost-ray

Distributed XGBoost on Ray

stumpy

STUMPY is a powerful and scalable Python library for modern time series analysis

numpydantic

Type annotations for specifying, validating, and serializing arrays with arbitrary backends in Pydantic (and beyond)

flox

Fast & furious GroupBy operations for dask.array

libcudf-cu12

cuDF - GPU DataFrame Library

dask-cloudprovider

Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...

pylibcudf-cu12

cuDF - GPU DataFrame Library

cudf-cu12

cuDF - GPU DataFrame Library

traceml

Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

dask-cudf-cu12

cuDF - GPU DataFrame Library

pyresample

Geospatial image resampling in Python

datatile

Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

pandas-summary

Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.