Search Packages

soup-cli

Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.

afterimage

Generate conversational, tool-calling, structured-output, and preference datasets — easily and at scale

mlx-lm-lora

Train LLMs on Apple silicon with MLX and the Hugging Face Hub

oumi

Easily fine-tune, evaluate and deploy gpt-oss, Qwen3, DeepSeek-R1, or any open source LLM / VLM!

openpo

Build high quality synthetic datasets with AI feedback from 200+ LLMs

oat-llm

🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.

sillm-mlx

Running and training LLMs on Apple Silicon via MLX

oxrl

A lightweight post-training framework for LLMs and VLMs

knowlyr-sandbox

Gymnasium-style RL framework for LLM agent training — MDP environments, three-layer process reward & SFT/DPO/GRPO policy optimization. CLI + MCP ready.

knowlyr-hub

Gymnasium-style RL framework for LLM agent training — MDP environments, three-layer process reward & SFT/DPO/GRPO policy optimization. CLI + MCP ready.

knowlyr-core

Gymnasium-style RL framework for LLM agent training — MDP environments, three-layer process reward & SFT/DPO/GRPO policy optimization. CLI + MCP ready.

knowlyr-recorder

Gymnasium-style RL framework for LLM agent training — MDP environments, three-layer process reward & SFT/DPO/GRPO policy optimization. CLI + MCP ready.

mlora-cli

The cli tools for mLoRA system.

knowlyr-reward

Gymnasium-style RL framework for LLM agent training — MDP environments, three-layer process reward & SFT/DPO/GRPO policy optimization. CLI + MCP ready.

toolbrain

A framework for agentic tool use training with reinforcement learning

sygra

SyGra - Graph-oriented Synthetic data generation Pipeline

knowlyr-trainer

PyTorch-based trainer for Agent trajectory datasets — SFT, DPO, GRPO

flash-pref

Accelerate LLM preference tuning via prefix sharing with a single line of code