PyPI Stats

Search Packages

Find Python packages by name, description, GitHub topic, or filter by metrics
lightseekorg
smg-grpc-proto

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

829K 206 62
lightseekorg
smg-grpc-servicer

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

560K 206 62
jjang-ai
vmlx

vMLX - Home of JANG_Q - Cont Batch, Prefix, Paged, KV Cache Quant, VL - Powers MLX Studio. Image gen/edit, OpenAI/Anth

36K 441 54
berkayildi
mcp-content-pipeline

MCP server for YouTube video analysis and X feed digests

6K 0 0
Oaklight
llm-rosetta

Production-ready LLM API translation layer for Python — bidirectional conversion between OpenAI, Anthropic & Google formats via hub-and-spoke IR. Optional API gateway. Streaming & non-streaming. Zero core deps. Contributions welcome!

6K 20 1
getbridgekit
bridgekit

AI tools that make you a better data scientist, not a redundant one.

3K 6 2
lightseekorg
smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

3K 206 62
BihanBanerjee
recollectx

Persistent memory layer for AI agents

3K 2 0
drupaltools
drupaltools-tip-generator

Generate static MD tip files for Drupal development tips using various LLM providers

2K 0 0
tokmacher
tok-protocol

tok is an invisible bridge

2K 0 0
lexxai
ollama-deproxy

A lightweight, feature-rich proxy for Ollama, designed for development, testing, and staging environments. It simplifies access to remote Ollama instances that are wrapped behind another proxy layer like OpenWebUI. Anthropic and OpenAI compatible endpoints, included.

593 0 0
Goekdeniz-Guelmez
local-notebooklm

Googles NotebookLM but local

568 891 111
vienneraphael
batchling

Save 50% off GenAI costs in two lines of code

246 20 0