Local Ai Python Packages

mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

foundry-local-sdk

Foundry Local Manager Python SDK: Control-plane SDK for Foundry Local.

lilbee

Terminal-first local search and AI chat over your documents, code, and crawled websites. Semantic + hybrid search, vision OCR, auto-built wiki, browsable GGUF model catalog. Works as CLI, TUI, MCP server, REST API, or Python library. Offline by default, no sidecar services.

llm-autotune

Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x.

knowledge-rag

Drop docs, search instantly from Claude Code — 12 MCP tools, 20 format parsers, hybrid search + reranking. Zero servers, zero API keys, 100% local.

foundry-local-sdk-winml

Foundry Local Manager Python SDK: Control-plane SDK for Foundry Local.

hey-cli-python

Your terminal buddy that turns plain English into shell scripts — and runs them. Powered by Ollama. 100% local, 100% private.

edgevox

Offline voice agent framework for robots.

pullnexus

Pull-on-demand skill registry for local LLMs. Search, install, and contribute skills, tools, datasets, and playbooks for Ollama, LM Studio, and any local AI setup.

ollama-mcp-bridge

Extend the Ollama API with dynamic AI tool integration from multiple MCP (Model Context Protocol) servers. Fully compatible, transparent, and developer-friendly, ideal for building powerful local LLM applications, AI agents, and custom chatbots

neurostack

Build, maintain, and search your knowledge vault. CLI + MCP server with stale note detection, semantic search, and neuroscience-grounded memory.

hellochusquis

Terminal AI agent with multi-provider fallback, file management, code execution, and persistent memory. Supports OpenRouter, Ollama, OpenAI, Anthropic, Gemini, Groq and 15+ more providers.

deepsleep-ai

Zero-cost background coding agent with layered memory, idle-time dreaming, MCP server, and Ollama support.

encoderfile

Python bindings for encoderfile.

artifex

Small Language Model Inference, Fine-Tuning and Observability.

mycoswarm

Distributed AI for everyone. Turn forgotten hardware into a thinking network.

lexaloud

A local, private Linux text-to-speech tool. Select text in any app, press a hotkey, hear it read by Kokoro-82M on your GPU.

gitbriefly

Your daily developer standup — powered by your Git history

velocirag

Lightning-fast RAG for AI agents. ONNX-powered, 4-layer fusion, MCP server. No PyTorch.

globalmm

Add vision to any local LLM, no training.

ltts

Quick CLI for local text-to-speech using Qwen3-TTS or Kokoro TTS.

locallens

Search your files by talking to them - 100% offline

guaardvark

The self-hosted AI workstation. Autonomous screen agents, 3-tier neural routing, parallel agent swarms, video generation, 4K/8K upscaling, RAG, voice interface, 57-tool execution engine — all running locally on your hardware.

quaynor

Embed local models in your app