Peft Python Packages

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-R1, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

gptqmodel

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

mcore-bridge

MCore-Bridge: Providing Megatron-Core model definitions for state-of-the-art large models and making Megatron training as simple as Transformers.

mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

soup-cli

Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.

abliterix

Automated alignment adjustment for LLMs — direct steering, LoRA, and MoE expert-granular abliteration, optimized via multi-objective Optuna TPE.

llmtuner

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

moe-peft

An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT

finetunecheck

Automated base vs fine-tuned LLM comparison with forgetting detection, capability retention scoring, and visual diff reports.

xturing

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

anchor-vision

Python client for Anchor — PaliGemma2 multi-LoRA vision inference

document-language-model

Document-first local LLM training, preference mining, retraining, and multi-target export from .dlm docs, codebases, and multimodal sources.

unsloth-mlx

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

lazyllm-llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

aletheia-lora

Gradient-guided layer selection for efficient LoRA fine-tuning across architectures

shadow-peft

ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning

selective-optimizers

Official implementation of the paper "Step-by-Step Unmasking for Parameter-Efficient Fine-tuning of Large Language Models"

glmtuner

Fine-tuning ChatGLM-6B with PEFT

simplifine-alpha

An easy to use, open-source LLM finetuning library that handles all the complexities of the process for you.

s0-tuning

Tune the initial recurrent state of hybrid models. Zero inference overhead.

mlora-cli

The cli tools for mLoRA system.

easylora

Batteries-included toolkit for LoRA / QLoRA fine-tuning with Hugging Face Transformers