Dataset Generation Python Packages

nfstream

NFStream: a Flexible Network Data Analysis Framework.

18K 1K 143

datasetrising

Toolchain for creating custom datasets and training Stable Diffusion (1.x, 2.x, XL) models and LoRAs

9K 18 1

lightningrod-ai

Python SDK for dataset generation on LightningRod platform ⚡

6K 44 3

kiln-ai

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

3K 5K 361

ragscore

⚡️ The "1-Minute RAG Audit" — Generate QA datasets & evaluate RAG systems in Colab, Jupyter, or CLI. Privacy-first, async, visual reports.

2K 31 5

scalexi

scalexi is a versatile open-source Python library, optimized for Python 3.11+, focuses on facilitating low-code development and fine-tuning of diverse Large Language Models (LLMs).

2K 13 2

kiln-server

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

1K 5K 361

modeyolo

ModeYOLO is a versatile Python package designed for efficient color space transformations and simplified dataset modification for deep learning applications. Seamlessly integrating into your workflow, this package empowers users to effortlessly perform diverse color operations and streamline the creation of modified datasets, enhancing the flexibility and convenience of machine learning model training processes.

1K 0 0

bpycv

Computer vision utils for Blender.

1K 501 60

human-eval-rust

SigilDERG Data Production is an enterprise-grade Rust pipeline that crawls crates, runs rigorous scans (Clippy, Geiger, license checks), and generates instruction-style JSONL shards. It features semantic chunking, configurable splits, observability, and seamless SigilDERG ecosystem integration.

1K 0 1

pyreports

pyreports is a python library that allows you to create complex report from various sources

885 113 9

stopes

A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB team.

752 303 46

scpscraper

A Python library designed for scraping data from the SCP wiki.

738 16 4

nlptoolkit-datagenerator

Classification dataset generator library for high level Nlp tasks

720 3 0

chatette

A powerful dataset generator for Rasa NLU, inspired by Chatito

688 315 53

data-seed-ph

A Python library for generating realistic, synthetic Philippine-based datasets.

672 8 0

iftg

IFTG (ImageFromTextGenerator) is a Python package that simplifies creating robust datasets for OCR models. Generate images from text, apply over 10 built-in noise effects, and customize fonts and layouts. IFTG supports all languages and offers endless noise combinations, including custom noise creation.

666 21 2