Search Packages

flashinfer-python

FlashInfer: Kernel Library for LLM Serving

flashinfer-cubin

FlashInfer: Kernel Library for LLM Serving

tightwad

Mixed-vendor GPU inference cluster manager with speculative decoding

sollol

Super Ollama Load Balancer - Performance-aware routing for distributed Ollama deployments with Ray, Dask, and adaptive metrics

vimin-core

Open-source local AI inference orchestration. Run open-source LLMs across a fleet of machines - no cloud, no API keys.

forge-sdk

Python SDK for the Forge compute economy — where AI agents earn and spend Compute Units

mlx-sharding

A package for MLX model sharding and distributed inference

forge-cu-mcp

MCP server for Forge compute economy — lets Claude, Cursor, and AI agents interact with CU