Search Packages

aphrodite-engine

Large-scale LLM inference engine

angelslim

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

intel-extension-for-transformers

Repository of Intel® Intel Extension for Transformers

tightwad

Mixed-vendor GPU inference cluster manager with speculative decoding

m5-infer

Extraordinary speed, extraordinary quality — an MLX-based inference engine for Apple Silicon.

eagle-llm

Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).

angelslim-fork

A toolkit for compress llm model.

opencac

OpenCAC: Claude Code, Antigravity, and Codex working together across cloud APIs and local models.

specstream

Fast LLM inference with 2.8x speedup using speculative decoding