Dataset Generation Python Packages

nfstream

NFStream: a Flexible Network Data Analysis Framework.

datasetrising

Toolchain for creating custom datasets and training Stable Diffusion (1.x, 2.x, XL) models and LoRAs

lightningrod-ai

Python SDK for dataset generation on LightningRod platform ⚡

kiln-ai

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

ragscore

⚡️ The "1-Minute RAG Audit" — Generate QA datasets & evaluate RAG systems in Colab, Jupyter, or CLI. Privacy-first, async, visual reports.

scalexi

scalexi is a versatile open-source Python library, optimized for Python 3.11+, focuses on facilitating low-code development and fine-tuning of diverse Large Language Models (LLMs).

modeyolo

ModeYOLO is a versatile Python package designed for efficient color space transformations and simplified dataset modification for deep learning applications. Seamlessly integrating into your workflow, this package empowers users to effortlessly perform diverse color operations and streamline the creation of modified datasets, enhancing the flexibility and convenience of machine learning model training processes.

kiln-server

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

bpycv

Computer vision utils for Blender.

human-eval-rust

SigilDERG Data Production is an enterprise-grade Rust pipeline that crawls crates, runs rigorous scans (Clippy, Geiger, license checks), and generates instruction-style JSONL shards. It features semantic chunking, configurable splits, observability, and seamless SigilDERG ecosystem integration.

pyreports

pyreports is a python library that allows you to create complex report from various sources

nlptoolkit-datagenerator

Classification dataset generator library for high level Nlp tasks

scpscraper

A Python library designed for scraping data from the SCP wiki.

chatette

A powerful dataset generator for Rasa NLU, inspired by Chatito

stopes

A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB team.

data-seed-ph

A Python library for generating realistic, synthetic Philippine-based datasets.

iftg

IFTG (ImageFromTextGenerator) is a Python package that simplifies creating robust datasets for OCR models. Generate images from text, apply over 10 built-in noise effects, and customize fonts and layouts. IFTG supports all languages and offers endless noise combinations, including custom noise creation.

d-arth

DATASETS FOR WHOLE E-ARTH

ccdown

A rust based, resumable downloader cli and python library for Common Crawl data

synbols

The Synbols dataset generator is a ServiceNow Research project that was started at Element AI.

datasetgpt

Generate textual and conversational datasets with LLMs.

timeeval-gutentag

A good Timeseries Anomaly Generator.

nlptoolkit-datagenerator-cy

Classification dataset generator library for high level Nlp tasks

ks-llm-ranker

Ranking Large Language Models using the Principle of Least Action! Built during my time at Knit Space, Hubbali under the guidance Prof. Prakash Hegade.