Batch Processing Python Packages

optbinning

Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.

async-batcher

A service to batch the http requests.

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

ondine

Batch-process tabular data with any LLM. pandas & Polars in, structured columns out. Checkpointing, budget limits, and 100+ providers built in.

nostos

Zero-dependency Python CLI for batch-updating and curating a fleet of git repositories. SQLite metadata index, fail-closed upstream probes (GitHub / GitLab / Gitea), weekly digest, Obsidian bridge.

snapmark

Python library for automated DXF file marking, batch processing, and CAM workflows

cheminformant

⚗️ An all-in-one solution for chemical property retrieval from PubChem.

pptx2png

一个将.pptx转换为.png图片的工具集: 包括一个Windows桌面端程序和一个Python库. | A toolkit for converting .pptx files into .png images, including a Windows desktop application and a Python library.

bacalhau-apiclient

Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.

napari-tmidas

A plugin for batch processing of confocal and whole-slide microscopy images of biological tissues

bacalhau-sdk

Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.

batch-img

Batch processing image files by utilizing **Pillow / PIL** library.

tempren

Template-based renaming utility

yaml-workflow

A lightweight, powerful, and flexible workflow engine that executes tasks defined in YAML configuration files.

fractalshades

Fractal deep-zoom explorer package for Mandelbrot fractal.

linqit

Extend python lists operations using .NET's LINQ syntax for clean and fast coding.

smelt-ai

LLM-powered structured data transformation. Batch process rows through any LLM, get back strictly typed Pydantic models.

bacalhau-airflow

Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.

homeinfotools

Tools to manage HOMEINFO Digital Signage Systems

openai-batch

Make OpenAI batch easy to use.

multidim-indexing

Batch multidimensional indexing for pytorch

aio-pika-batch

Batch consumer for aio-pika with per-message ACK/NACK/REQUEUE, retry tracking, dead-letter routing, and multi-worker scaling. The missing batch layer for RabbitMQ in Python.

imageconvert

A lightweight Python library for converting images between formats (JPEG, PNG, WebP, SVG, RAW, HEIC, etc.) with metadata and timestamp preservation.

covalent-awsbatch-plugin

Covalent AWS Batch Plugin