Inference Server Python Packages

inference-gpu

Turn any computer or edge device into a command center for your computer vision projects.

1.1M 2K 260

inference-cli

Turn any computer or edge device into a command center for your computer vision projects.

836K 2K 260

truss

The simplest way to serve AI/ML models in production

632K 1K 102

truss-transfer

The simplest way to serve AI/ML models in production

300K 1K 102

baseten-performance-client

The simplest way to serve AI/ML models in production

182K 1K 102

inference-sdk

Turn any computer or edge device into a command center for your computer vision projects.

163K 2K 260

inference

Turn any computer or edge device into a command center for your computer vision projects.

119K 2K 260

ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

11K 3K 337

inference-core

Turn any computer or edge device into a command center for your computer vision projects.

9K 2K 260

inference-cpu

Turn any computer or edge device into a command center for your computer vision projects.

7K 2K 260

friendli-client

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

5K 50 7

fastdeploy

Deploy DL/ ML inference pipelines with minimal extra code.

4K 103 17

infergrid

Tenant-fair LLM inference orchestration on a single GPU. No Kubernetes.

2K 1 1

baseten-inference-client

The simplest way to serve AI/ML models in production

2K 1K 102

geniusrise-vision

Huggingface bolts for geniusrise

1K 7 1

kvwarden

Tenant-fair LLM inference orchestration on a single GPU. No Kubernetes.

996 2 1

fdclient

fastDeploy python client

815 103 17

pipeless-ai

An open-source computer vision framework to create and deploy computer vision applications that scale in minutes

699 850 52

geniusrise-audio

audio bolts for geniusrise

658 2 1

pipeless-ai-cli

An open-source computer vision framework to build and deploy apps in minutes

624 850 52

geniusrise-text

Text components powering LLMs & SLMs for geniusrise framework

551 5 2

pinferencia

Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

512 545 83

periflow-client

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

503 50 7

smart-reid

Turn any computer or edge device into a command center for your computer vision projects.

308 2K 260

Search Packages