Search Packages

liger-kernel

Efficient Triton Kernels for LLM Training

sageattention

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

liger-kernel-nightly

Efficient Triton Kernels for LLM Training

tritonparse

TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels

clearml-serving

ClearML - Model-Serving Orchestration and Repository Solution

turboquant-vllm

TurboQuant KV cache compression plugin for vLLM — asymmetric K/V, 8 models validated, consumer GPUs

fastdeploy

Deploy DL/ ML inference pipelines with minimal extra code.

hilbertsfc

Ultra-fast 2D & 3D Hilbert curve kernels in Python. JIT compiled, branchless, L1-cache-friendly lookup tables, loop unrolling, SIMD, and multi-threading.

torchgw

Fast Sampled Gromov-Wasserstein optimal transport solver — pure PyTorch, scalable, differentiable

flash-sinkhorn

Sinkhorn optimal transport kernels in PyTorch + Triton (squared Euclidean, no cost matrix materialization).

dlblas

DLBlas: clean and efficient kernels

triton-runner

Multi-Level Triton Runner supporting Python, IR, PTX, AMDGCN, cubin and hasco.

fdclient

fastDeploy python client

flag-gems

FlagGems is an operator library for large language models implemented in the Triton Language.

flash-sparse-attn

Trainable fast and memory-efficient sparse attention

triformer

Transformers components but in Triton

hip-attn

Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.

atlas-quantum

GPU-accelerated quantum tensor network simulator with adaptive MPS

transformersplus

Add Some plus extra features to transformers

grammared-language

Adding Grammarly (and other) open source ML models to LanguageTool

tritonllm

LLM Inference via Triton (Flexible & Modular): Focused on Kernel Optimization using CUBIN binaries, Starting from gpt-oss Model

fused-turboquant

Fused Triton encode/decode kernels for TurboQuant KV cache compression, powered by Randomized Hadamard Transform.

quick-deploy

Optimize, convert and deploy machine learning models as fast inference API using Triton and ORT. Currently support Hugging Face transformers, PyToch, Tensorflow, SKLearn and XGBoost models.

ssblast

FP8 per-tile scaled linear solver for consumer NVIDIA GPUs