Search Packages

vllm-cpu

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-cpu-avx512bf16

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-cpu-avx512vnni

vLLM CPU inference engine (AVX512 + VNNI optimized)

vllm-cpu-amxbf16

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-cpu-avx512

vLLM CPU inference engine (AVX512 optimized)

agentsculptor

AgentSculptor: Refactor, restructure & modernize codebases with natural language — powered by GPT-OSS and vLLM.

mvllm

Intelligent load balancer for distributed vLLM server clusters 分布式 vLLM 服务器集群的智能负载均衡器