23 dependents
Package Description Downloads/month
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API e... 18K
Konfuzio Software Development Kit 13K
The easiest way to serve AI apps and models - Build Model Inference APIs, Job qu... 2K
CLIP as a service - Embed image and sentences, object recognition, visual reason... 944
A comprehensive toolkit for reliably locking, packing and deploying environments... 860
802
Fast model deployment on any cloud 🚀 607
This project aims to combine the awesome capabilities of BentoML in packaging mo... 457
BentoML extension for ComfyUI 345
Bento service with SGLang Router included 289
BentoML generated model module 235
Framework for creating, running and validation of ML models on tabular data 213
Transform your pythonic research to an artifact that engineers can deploy easily... 199
Onediffusion: REST API server for running any diffusion models - Stable Diffusio... 168
Chatbot with LLM 161
153
End-to-end ML workflow CLI - from dataset to deployed API 126
112
the swish knife to all things bentoml. 107
Nidam: Self-hosting LLMs Made Easy. 106
Kaze MLOps stack 88
A one-stop ML meta-package for all essential libraries 78
ComfyUI engine modules 34