Sparsity Python Packages

torchao

PyTorch native quantization and sparsity for training and inference

nncf

Neural Network Compression Framework for enhanced OpenVINO™ inference

tensorflow-model-optimization

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

tf-model-optimization-nightly

A suite of tools that users, both novice and advanced can use to optimize machine learning models for deployment and execution.

sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

sconce

E2E AutoML Model Compression Package

sporco

Sparse Optimisation Research Code

neural-compressor-pt

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

fasterai

FasterAI: Prune and Distill your models with FastAI and PyTorch

asdex

Automatic Sparse Differentiation in JAX.

neural-speed

An innovative library for efficient LLM inference via low-bit quantization

neural-compressor-tf

Repository of Intel® Neural Compressor

neural-compressor-full

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

neural-solution

Repository of Intel® Neural Compressor

lpot

Repository of Intel® Low Precision Optimization Tool

neural-insights

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

magni

A package for AFM image reconstruction and compressed sensing in general

randomly

A Library for Denoising Single-Cell Data with Random Matrix Theory

ilit

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

tensorflow-engram

A Python package for Engram Neural Networks, adding biologically-inspired Hebbian memory and engram layers to TensorFlow/Keras models, supporting memory traces, plasticity, attention, and sparsity for neural sequence learning.

veloce

Veloce: An instant distributed computing library based on Ray stack

gslr

An algorithm for classification from a graph-sparse support

torch-sconce

E2E AutoML Model Compression Package