Search Packages

ollama-herd

Local AI load balancer for Ollama fleets — auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

airflow-balancer

Utilities for tracking hosts and ports and load balancing DAGs

sollol

Super Ollama Load Balancer - Performance-aware routing for distributed Ollama deployments with Ray, Dask, and adaptive metrics

openai-priority-loadbalancer

A multi-backend, prioritization load balancer for OpenAI

nya-proxy

A lightweight, flexible API proxy with dynamic token rotation, load balancing, and rate limiting capabilities.

paddler-client

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

proxlb

An advanced resource scheduler and load balancer for Proxmox clusters.

f5-openstack-lbaasv2-driver

F5 LBaaSv2 service provider driver for OpenStack Liberty and beyond

sharkradar

Lightweight micro service registry and discovery tool, compatible with any HTTP based microservice

elb-py

Eru load balancer

berserker-resolver

Fast mass dns resolver

pymako

A Consul Client for Python.

pyalb

A simple application load balancer

openstack-lb-treeview

Displays a tree view of all loadbalancers in an OpenStack project, showing pools and members in a hierarchical structure

pyloadbalancer

A load-balancer package for Python