Training Data Python Packages

snorkel

A system for quickly generating training data with weak supervision

amazoncaptcha

Pure Python, lightweight, Pillow-based solver for Amazon's text captcha.

composeml

A machine learning tool for automated prediction engineering. It allows you to easily structure prediction problems and generate labels for supervised learning.

ydata-synthetic

Synthetic data generators for tabular and time-series data

augraphy

Augmentation pipeline for rendering synthetic paper printing, faxing, scanning and copy machine processes

augmenty

Augmenty is an augmentation library based on spaCy for augmenting texts.

s2s-certify

Physics-audit engine for Physical AI. 8 biomechanical laws certified in real-time — safety gate for robot training pipelines and prosthetics. pip install s2s-certify

skweak

skweak: A software toolkit for weak supervision applied to NLP tasks

datamix

Dataset mixing & curriculum optimizer — profile, blend, schedule, and budget training data. Zero deps.

datacruxai

Lightweight CPU-only data quality toolkit for LLM instruction tuning datasets.

castwright

Generate high-quality synthetic instruction-tuning data from seed examples. Simple API, built-in quality filtering, cost-aware.

ladon-crawl

A Python framework for building structured, resumable web crawlers — designed for domains where data quality matters.

tidbit

Capture anything into structured Markdown notes and training-ready JSONL.

knowlyr-datasynth

Seed-to-scale LLM synthetic data engine with auto-detected templates, schema validation & quality-diversity optimization. CLI + MCP ready.

fg-data-synthetic

Synthetic data generation methods with different synthetization methods.

ai-dataset-radar

Multi-source async competitive intelligence engine for AI training data ecosystems with watermark-driven incremental scanning & anomaly detection. CLI + MCP ready.

codeclaw

CLI for exporting Claude Code/Codex sessions to Hugging Face with privacy redaction, MCP memory, and share-ready dataset workflows.

mockloop-mcp

MCP server to generate and run mock APIs from specifications.

lg3k

Log Generator 3000 - A modular log generation tool

pdf-anonymizer-cli

An app and an SDK to anonymize large PDF files

pdf-anonymizer-core

An app and an SDK to anonymize large PDF files

iflow-mcp-mockloop-mockloop-mcp

MCP server to generate and run mock APIs from specifications.

veritas-truth-adapter

LoRA training data and adapter management for teaching AI models truthful, hedged responses. Built on SovereignShield's TruthGuard pipeline.

srtvoiceext

A command line interface to combine text information from subtitles with voice data in the video. Provides a convenient way to generate training data for speech-recognition purposes.