Vertex Ai Python Packages

litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

langchain-google-vertexai

🦜🔗 LangChain interfaces to Google's suite of AI products (e.g. Gemini & Vertex AI)

langchain-google-genai

🦜🔗 LangChain interfaces to Google's suite of AI products (e.g. Gemini & Vertex AI)

langchain-google-community

🦜🔗 LangChain interfaces to Google's suite of AI products (e.g. Gemini & Vertex AI)

litellm-proxy-extras

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

litellm-enterprise

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

agentmake

AgentMake AI: a kit for developing agentic AI applications that support 24 AI backends and and work with 7 agentic components, such as tools and agents. (Developer: Eliran Wong) Supported backends: anthropic, azure, azure_any, cohere, custom, deepseek, genai, github, github_any, googleai, groq, llamacpp, mistral, ollama, openai, vertexai, xai

lmux-gcp-vertex

Modular Python library for unified LLM provider access with cost reporting

lmux-aws-bedrock

Modular Python library for unified LLM provider access with cost reporting

lmux-azure-foundry

Modular Python library for unified LLM provider access with cost reporting

lmux-anthropic

Modular Python library for unified LLM provider access with cost reporting

lmux-groq

Modular Python library for unified LLM provider access with cost reporting

lmux

Modular Python library for unified LLM provider access with cost reporting

llmstudio

Framework to bring LLM applications to production

lmux-openai

OpenAI provider for lmux

autollm

Ship RAG based LLM web apps in seconds.

google-cloud-automlops

Build MLOps Pipelines in Minutes

modelsmith

Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex AI and OpenAI models

autourgos-llmkit

Autourgos LLMKit is a lightweight toolkit that unifies access to multiple LLM providers for building agentic AI systems.

dataproc-ml

A python library to ease MLOps for Dataproc customers

langgate

Lightweight AI inference gateway - local model registry & parameter transformer (Python SDK) - with optional Envoy proxy processor and FastAPI registry server deployment options.

teamgenai

TeamGen AI, developed by Eliran Wong, automates the creation of AI agent teams to address user requests.

markdown-fastrag-mcp

Semantic search engine for markdown documents. MCP server with multi-provider embeddings and Milvus vector storage.

grepctl

BigQuery Semantic Search Orchestrator