ClearML Agent - ML-Ops made easy. ML-Ops scheduler & orchestration solution
Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)