Search Packages

llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

myllm

A python package to interact with llm model

macafm

Access Apple's on-device Foundation Models via CLI and OpenAI-compatible API

shelloracle

A terminal utility for intelligent shell command generation

llama-optimus

Lightweight Python tool using Optuna for tuning llama.cpp flags: towards optimal tok/s for your machine

langchain-localai

Langchain integration package with LocalAI. It provides embeddings and reranker support

r-cli-ai

Local AI Agent Runtime

maclocal-ai

Local LLM inference on Apple Silicon

maclocal

Local LLM inference on Apple Silicon

ericchat

A Mac GUI for running LLMs locally and privately.

r-cli-sdk

Local AI Agent Runtime