Search Packages

sageattention

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

turbodiffusion

TurboDiffusion: video generation acceleration framework that could accelerate end-to-end video generation by 100-205x with negligible video quality loss.

autonomi-nos

⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.

torch-nos

Nitrous Oxide for your AI Infrastructure.