PyPI Stats
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About
Home

Dataloader Python Packages

Python packages with the GitHub topic dataloader. Sorted by relevance, with stars and monthly downloads.
bendangnuksung
dynabatch

PyTorch/Hugging Face batching utility that sorts variable-length text by difficulty, then dynamically increases batch size on easier samples using a pre-trained VRAM predictor to improve GPU utilization and throughput while reducing OOM risk with fallback handling.

9K 1 0
surister
conecta

SQL to Arrow made easy.

9K 5 0
photoroom
datago

A natively parallel dataloader for Python, written in Rust. Serving data at GB/s speeds, while covering aspect ratio bucketing, crop and resize for image ML workloads.

4K 128 7
birkhoffg
jax-dataloader

Pytorch-like dataloaders for JAX.

4K 103 4
janelia-cellmap
cellmap-data

Utility for loading CellMap data for machine learning training, utilizing PyTorch, TensorStore, Xarray, and PyDantic.

3K 7 3
jkobject
scdataloader

a dataloader to work with large single cell datasets from lamindb

3K 40 6
Continvvm
continuum

A clean and simple data loading library for Continual Learning

2K 447 43
fal-ai
lavender-data

Load & manage evolving datasets efficiently

1K 23 0
unum-cloud
ukv

Python bindings for Unum's UStore.

1K 631 35
IRVLUTD
fewsoldataloader

This repo hosts the PyTorch dataloader for FewSOL dataset | ICRA 2023

1K 2 0
torchvtk
torchvtk

PyTorch volume toolkit. Efficient data loading, dataset conversions, visualization tools

798 10 2
dvm-shlee
bruker

A modular toolkit for Bruker MRI raw-data handling.

706 56 30
zensors
datatap

Focus on Algorithm Design, Not on Data Wrangling

518 34 3
srpraneeth
torch-dataloader-utils

Efficient Data Loader Utils for loading data from structured sources into Pytorch

474 0 0
willGuimont
torch-waymo

PyTorch dataloader for Waymo Open Dataset

449 18 4
nzx9
vdataset

Load video datasets to PyTorch DataLoader. (Custom Video Data set for PyTorch DataLoader)

336 0 0
SerezD
ffcv-pl

manage fast data loading with ffcv and pytorch lightning

333 16 0
rodrigobdz
lrp-pf-auc

Explain Neural Networks using Layer-Wise Relevance Propagation and evaluate the explanations using Pixel-Flipping and Area Under the Curve.

304 17 1
DBraun
audiotree

Audio data loading and augmentations in JAX

260 5 1
redhottensors
hydrax

A zero-copy multiprocess dataloader for JAX.

257 1 0
inikishev
light-dataloader

Faster DataLoader for datasets that are fully loaded into memory as tensors.

253 3 0
oinopion
dloader

A Python implementation of the DataLoader pattern for data fetching with automatic batching.

184 0 0
CEA-LIST
rpcdataloader

A variant of the PyTorch Dataloader using remote workers.

141 21 1
vanheeringen-lab
peaksql

Dynamic machine learning database for genomics.

137 0 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery