Search Packages

bespokelabs-curator

Synthetic data curation for post-training and structured data extraction

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

gritlm

Generative Representational Instruction Tuning

py-data-juicer

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

convmerge

Merge heterogeneous chat/text sources into a single LLM training format (JSONL)

datadreamer-dev

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

tasksource

Datasets collection and preprocessings framework for NLP extreme multitask learning

llmtuner

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

llava-torch

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

decontaminate

`decon`, but with python API binding.

castwright

Generate high-quality synthetic instruction-tuning data from seed examples. Simple API, built-in quality filtering, cost-aware.

lazyllm-llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

otter-ai

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

scar-tool

SCAR: An AI-powered tool for ranking and filtering instruction-answer pairs based on writing quality and style consistency

simplifine-alpha

An easy to use, open-source LLM finetuning library that handles all the complexities of the process for you.

vibeprompt

🦩VibePrompt. A lightweight Python package for adapting prompts by tone, style, and audience. Built on top of LangChain, VibePrompt supports multiple LLM providers and enables structured, customizable prompt transformations for developers, writers, and researchers.

llamafactory-songlab

Easy-to-use LLM fine-tuning framework