Llm Ops Python Packages

openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

ultracontext

Open Source Context infrastructure for AI agents. Auto-capture and share your agents' context everywhere.

autorag

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

friendli-client

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

python-aiconfig

AIConfig is a config-based framework to build generative AI applications.

agentcontract

Python reference implementation of the AgentContract specification

aiconfig-extension-hugging-face

An extension for using Hugging Face tasks to parse models for AIConfig.

moralstack

MoralStack is a governance and safety layer for LLM applications. It analyzes user requests before generation, evaluates risk and intent, and decides whether the AI should answer normally, answer safely, or refuse. The goal is to make AI systems more auditable, controllable, and reliable in sensitive or regulated contexts.

prosperus

LLM observability platform: traces, spans, evaluations, and cost tracking for AI-powered applications

wildedge-sdk

Python SDK for WildEdge

periflow-client

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

aiconfig-extension-gemini

AIConfig is a config-based framework to build generative AI applications.

aiconfig-extension-llama-guard

AIConfig is a config-based framework to build generative AI applications.

ai-sdlc-framework

Python SDK for the AI-SDLC Framework

liteswarm

A lightweight framework for building AI agent systems

agent-policy-layer

Agent Policy Layer - Portable, composable policies for AI agents

lm-debug-eval-ui

LLM Application Debug/Eval UI on top of AIConfig

aiconfig-extension-llama

AIConfig is a config-based framework to build generative AI applications.

openrouter-inspector

A lightweight CLI for exploring OpenRouter AI models, listing provider endpoints with supported model parameters, and benchmarking endpoint latency and throughput.

aiconfig-extension-groq

AIConfig is a config-based framework to build generative AI applications.

arguslm

ArgusLM — Open-source LLM monitoring & benchmarking SDK

agent-os-observability

[DEPRECATED] Moved to microsoft/agent-governance-toolkit