Pruning Python Packages

nncf

Neural Network Compression Framework for enhanced OpenVINO™ inference

tensorflow-model-optimization

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

aimet-torch

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

torch-pruning

[CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.

neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

aimet-onnx

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

cozempic

Context cleaning for Claude Code — prune bloated sessions, protect Agent Teams from context loss, auto-guard with tiered pruning

tf-model-optimization-nightly

A suite of tools that users, both novice and advanced can use to optimize machine learning models for deployment and execution.

deepsparse

Sparsity-aware deep learning inference runtime for CPUs

deepsparse-ent

Sparsity-aware deep learning inference runtime for CPUs

sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

sparsezoo

Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

sconce

E2E AutoML Model Compression Package

micronet

A model compression and deploy lib.

neural-compressor-pt

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

fasterai

FasterAI: Prune and Distill your models with FastAI and PyTorch

delve

PyTorch model training and layer saturation monitor

sparsify

ML model optimization product to accelerate inference.

mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.

torch-optim

PyTorch models optimization by neural network pruning

neural-compressor-tf

Repository of Intel® Neural Compressor

only-train-once

Only Train Once (OTO): Automatic One-Shot General DNN Training and Compression Framework

neural-compressor-full

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

heflwr

HeFlwr: Federated Learning for Heterogeneous Devices