Parquet Python Packages

pyarrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

influxdb3-python

Python module that provides a simple and convenient way to interact with InfluxDB 3.0.

awkward0

Manipulate arrays of complex data structures as easily as Numpy.

petastorm

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

parquet-metadata

Dump metadata about a Parquet file.

parquet-tools

easy install parquet-tools

lonboard

Fast, interactive geospatial data visualization in Jupyter.

dask-deltatable

A Delta Lake reader for Dask

pysail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

quilt3

Quilt is a Scientific Data Management Platform on AWS that helps teams and AI find, trust, and reuse data through deeply versioned, context-rich data packages.

airflow-provider-xlsx

Airflow operators for converting XLSX files from/to Parquet/CSV/JSON

koala-diff

High-performance data diff tool in Rust.

parquet-py

A simple command-line interface & Python API for parquet

daft-lts

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

fast-xml-flattener

Fast XML flattening library with Python bindings

mat-vis-client

Pure Python client for mat-vis PBR textures — HTTP range reads, zero deps

cryo

cryo is the easiest way to extract blockchain data to parquet, csv, json, or python dataframes

polars-config-meta

A Polars plugin for persistent DataFrame-level metadata

imctermite

Enables extraction of measurement data from binary files with extension 'raw' used by proprietary software imcFAMOS/imcSTUDIO and facilitates its storage in open source file formats

slothdb

SlothDB is an embedded SQL database that runs everywhere: on your laptop, on a server, and in the browser. Built from scratch. Up to 5x faster where it counts.

arrowjet

The fastest way to move data in and out of database.

vis3

Data browser based on s3. 一个基于 S3 的数据（json / jsonl / parquet / html / md等）可视化工具。👇 Try online.

deepcsv

Automatically processes data files in directories, converts array-like strings to NumPy arrays, detects and fixes data type issues, and saves results as optimized Parquet files and MORE!