PyPI Stats
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About
Home

Search Packages

Find Python packages by name, description, GitHub topic, or filter by metrics
bendangnuksung
dynabatch

PyTorch/Hugging Face batching utility that sorts variable-length text by difficulty, then dynamically increases batch size on easier samples using a pre-trained VRAM predictor to improve GPU utilization and throughput while reducing OOM risk with fallback handling.

10K 1 0
surister
conecta

SQL to Arrow made easy.

10K 5 0
photoroom
datago

A natively parallel dataloader for Python, written in Rust. Serving data at GB/s speeds, while covering aspect ratio bucketing, crop and resize for image ML workloads.

4K 128 7
birkhoffg
jax-dataloader

Pytorch-like dataloaders for JAX.

3K 103 4
Continvvm
continuum

A clean and simple data loading library for Continual Learning

3K 447 43
janelia-cellmap
cellmap-data

Utility for loading CellMap data for machine learning training, utilizing PyTorch, TensorStore, Xarray, and PyDantic.

2K 7 3
jkobject
scdataloader

a dataloader to work with large single cell datasets from lamindb

2K 40 6
fal-ai
lavender-data

Load & manage evolving datasets efficiently

1K 23 0
IRVLUTD
fewsoldataloader

This repo hosts the PyTorch dataloader for FewSOL dataset | ICRA 2023

1K 2 0
unum-cloud
ukv

Python bindings for Unum's UStore.

1K 631 35
torchvtk
torchvtk

PyTorch volume toolkit. Efficient data loading, dataset conversions, visualization tools

727 10 2
dvm-shlee
bruker

A modular toolkit for Bruker MRI raw-data handling.

668 56 30
zensors
datatap

Focus on Algorithm Design, Not on Data Wrangling

494 34 3
srpraneeth
torch-dataloader-utils

Efficient Data Loader Utils for loading data from structured sources into Pytorch

437 0 0
willGuimont
torch-waymo

PyTorch dataloader for Waymo Open Dataset

401 18 4
SerezD
ffcv-pl

manage fast data loading with ffcv and pytorch lightning

368 16 0
nzx9
vdataset

Load video datasets to PyTorch DataLoader. (Custom Video Data set for PyTorch DataLoader)

303 0 0
rodrigobdz
lrp-pf-auc

Explain Neural Networks using Layer-Wise Relevance Propagation and evaluate the explanations using Pixel-Flipping and Area Under the Curve.

291 17 1
DBraun
audiotree

Audio data loading and augmentations in JAX

264 5 1
redhottensors
hydrax

A zero-copy multiprocess dataloader for JAX.

251 1 0
inikishev
light-dataloader

Faster DataLoader for datasets that are fully loaded into memory as tensors.

229 3 0
oinopion
dloader

A Python implementation of the DataLoader pattern for data fetching with automatic batching.

172 0 0
vanheeringen-lab
peaksql

Dynamic machine learning database for genomics.

131 0 0
CEA-LIST
rpcdataloader

A variant of the PyTorch Dataloader using remote workers.

120 21 1
    • Data from PyPI, GitHub, ClickHouse, and BigQuery