Triton Inference Server Python Packages

clearml-serving

ClearML - Model-Serving Orchestration and Repository Solution

11K 164 50

fastdeploy

Deploy DL/ ML inference pipelines with minimal extra code.

4K 103 17

fdclient

fastDeploy python client

815 103 17

hami-core

Serving Inside Pytorch

642 171 13

tcm-client

AI inference gateway for OpenStack + Docker + NVIDIA Triton with zero-copy SHM, multi-tenant queuing, and HTTP/gRPC endpoints.

596 0 0

tritony

Tiny configuration for Triton Inference Server

564 45 1

grammared-language

Adding Grammarly (and other) open source ML models to LanguageTool

314 6 0

kubrick-cli

A cli tool for having a conversation with an LLM and tool calling for help you code.

282 1 0

tcm-client-test

Official Python WebSocket client for Triton Client Manager.

73 0 0

Search Packages