Finetuning Python Packages

flaml

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.

liger-kernel

Efficient Triton Kernels for LLM Training

qianfan

Provide best practices for LMOps, as well as elegant and convenient access to the features of the Qianfan MaaS Platform. (提供大模型工具链最佳实践，以及优雅且便捷地访问千帆大模型平台）

liger-kernel-nightly

Efficient Triton Kernels for LLM Training

soup-cli

Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.

datasetrising

Toolchain for creating custom datasets and training Stable Diffusion (1.x, 2.x, XL) models and LoRAs

nemo-automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

learn2learn

A PyTorch Library for Meta-learning Research

finetuning-scheduler

A PyTorch Lightning extension that accelerates and enhances foundation model experimentation with flexible fine-tuning schedules.

datasety

CLI tool for dataset preparation: resize, align, caption, shuffle, synthetic, and mask generation.

phi-3-vision-mlx

Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon

finetuner

Task-oriented finetuning for better embeddings on neural search.

tapeagents

TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle

openpo

Build high quality synthetic datasets with AI feedback from 200+ LLMs

llama-recipes

This is a compatibility package to keep projects build on llama-recipes compatible with the new name llama-cookbook. If you're updating your project or starting a new one please use llama-cookbook package

llama-cookbook

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

quickllm

QuickLLM: Fast and Easy Fine-tuning for Popular Language Models

xturing

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

fight-detection

Fight Detection From Surveillance Cameras by fine-tuning a PyTorch Pretrained Model

datasetpipeline

A data processing and analysis pipeline designed to handle various jobs related to data transformation, quality assessment, deduplication, and formatting. The pipeline can be configured and executed using YAML configuration files.

process-supervision-torch

Process SuperVision - Pytorch

llm-toolkit

LLM Finetuning resource hub + toolkit

open-retrievals

All-in-One: Text Embedding, Retrieval, Reranking and RAG in Transformers

feight-detection-from-surveillance-cameras

Fight Detection From Surveillance Cameras by fine-tuning a PyTorch Pretrained Model