Search Packages

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

coding-proxy

A High-Availability, Transparent, and Smart Multi-Vendor Proxy for Claude Code. Support Claude Plans, GitHub Copilot, Google Antigravity, ZAI/GLM, MiniMax, Qwen, Xiaomi, Kimi, Doubao...

kitty-bridge

Universal LLM bridge for AI agents. Use Claude Code with MiniMax, Codex with GLM, or Gemini CLI with OpenRouter — one command, any provider. Works with coding agents, OpenClaw, Hermes, and others.

devorch

A terminal-native, multi-provider intelligent assistant that plans, executes, and tracks developer tasks, not just answers prompts, similar to Claude Code and Gemini CLI.

vllm-hust

A high-throughput and memory-efficient inference and serving engine for LLMs

wxy-test

A high-throughput and memory-efficient inference and serving engine for LLMs

llm-onesdk

OneSDK is a Python library that provides a unified interface for interacting with various Large Language Model (LLM) providers.

vllm-xft

A high-throughput and memory-efficient inference and serving engine for LLMs

ai-dynamo-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-acc

A high-throughput and memory-efficient inference and serving engine for LLMs

nextai-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-consul

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-npu

A high-throughput and memory-efficient inference and serving engine for LLMs

kimi4free

Simple API Wrapper for Kimi

vllm-musa

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-rocm

A high-throughput and memory-efficient inference and serving engine for LLMs

chatpilot

ChatPilot: Chat Agent Web UI，实现Chat对话前端，支持Google搜索、文件网址对话（RAG）、代码解释器功能，复现了Kimi Chat(文件，拖进来；网址，发出来)。

vllm-emissary

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-usf

A high-throughput and memory-efficient inference and serving engine for LLMs

aether-cli

A command-line interface for interacting with various AI models.

tilearn-infer

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-online

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-test-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs