Rlhf Python Packages

transformerlab

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

image-reward

[NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

transformerlab-cli

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

rubrix

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

py-openjudge

OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards

trinity-rft

Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (LLM).

kiln-ai

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

mlx-lm-lora

Train LLMs on Apple silicon with MLX and the Hugging Face Hub

log10-io

Python client library for improving your LLM app accuracy

llmtuner

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

textrl

TextRL - reinforcement learning for text generation, built on HuggingFace TRL.

argilla-server

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

kiln-server

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

openpo

Build high quality synthetic datasets with AI feedback from 200+ LLMs

oat-llm

🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.

lmxlab

Transformer language models on Apple Silicon with MLX

lazyllm-llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

instruct-goose

Implementation of Reinforcement Learning from Human Feedback (RLHF)

aepo

Annotation Efficient Preference Optimization

knowlyr-datalabel

Serverless annotation framework with LLM pre-labeling, inter-annotator agreement analysis & offline HTML interface. CLI + MCP ready.

glmtuner

Fine-tuning ChatGLM-6B with PEFT

oxrl

A lightweight post-training framework for LLMs and VLMs

alignment-handbook

Robust recipes to align language models with human and AI preferences