Openai Compatible Python Packages

mlx-openai-server

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

cli-anything-zotero

CLI & MCP server for Zotero 7/8 — let AI manage your library. 52 MCP tools + 70+ CLI commands for search, import, PDF, BibTeX, notes, and more. Works with Claude, Cursor, ChatGPT.

initrunner

Define AI agent roles in YAML and run them anywhere: CLI, API server, or autonomous daemon

agenticore

Two modes, one binary — a fleet orchestrator that clones repos and ships PRs via Claude Code, OR a drop-in OpenAI-compatible chat completion endpoint for customized Claude agents with real-time token-by-token thinking + tool-call streaming. LibreChat/OpenWebUI/LiteLLM-ready. Helm + KEDA + OTEL.

openai-local-bridge

Trae 用第三方 API Codex。Make Trae use GPT Codex with any OpenAI-compatible API.

wauldo

Official Python SDK for Wauldo — verified AI answers with zero hallucinations. pip install wauldo

tightwad

Mixed-vendor GPU inference cluster manager with speculative decoding

ollama-herd

Local AI load balancer for Ollama fleets — auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

openchatci

The localhost AI Agent Runtime -- Chat UI, Tools, RAG, and MCP in one pip install

freeride-gateway

One free AI endpoint, every free tier behind it. Local OpenAI-compatible gateway routing across OpenRouter, Groq, NVIDIA NIM, Cloudflare Workers AI, and HuggingFace with automatic failover.

aigateway-py

Official Python SDK for AIgateway. Published on PyPI as aigateway-py.

code-review-ai

Multi-agent code review CLI using NVIDIA Nemotron 3 Super

crewai-pathcourse

PCH adapters for LangChain, CrewAI, Pydantic AI, AutoGen, and the Vercel AI SDK - autonomous agent inference with USDC billing on Base L2

pydantic-ai-pathcourse

PCH adapters for LangChain, CrewAI, Pydantic AI, AutoGen, and the Vercel AI SDK - autonomous agent inference with USDC billing on Base L2

autogen-pathcourse

PCH adapters for LangChain, CrewAI, Pydantic AI, AutoGen, and the Vercel AI SDK - autonomous agent inference with USDC billing on Base L2

langchain-pathcourse

PCH adapters for LangChain, CrewAI, Pydantic AI, AutoGen, and the Vercel AI SDK - autonomous agent inference with USDC billing on Base L2

lexilux

Unified LLM API client library for Python. Simple API for Chat, Embedding, Rerank, and Tokenizer. OpenAI-compatible with streaming support and unified usage tracking.

ragret

Lightweight evaluation framework for Retrieval Augmented Generation systems, focused on simplicity and long-term consistency.

toolsgen

A modular Python library for synthesizing tool-calling datasets from JSON tool definitions using an LLM-as-a-judge pipeline. Designed for OpenAI-compatible APIs.

codex-openai-server

OpenAI-compatible FastAPI server backed by locally authenticated ChatGPT Codex.

aisafeguard

Open-source LLM safety guardrails: prompt injection protection, PII redaction, toxicity filtering, and OpenAI-compatible AI proxy

llmock

Local mock server for testing LLM retries, fallbacks, and provider failure handling without spending tokens.

enzu

Budgeted LLM runs with hard caps + typed outcomes + async job mode. Python/CLI/HTTP. OpenAI-compatible.

mlx-serve

Local inference server for Apple Silicon — hot-swaps MLX models (LLM, vision, embeddings, TTS, STT) via OpenAI API