PyPI Stats

depyf

Packages that depend on this package
15 dependents
Package Description Downloads/month
vllm-project vllm
A high-throughput and memory-efficient inference and serving engine for LLMs 9.4M
vllm-project vllm-tpu
A high-throughput and memory-efficient inference and serving engine for LLMs 143K
MekayelAnik vllm-cpu
Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe... 31K
aphrodite-engine aphrodite-engine
Large-scale LLM inference engine 7K
MekayelAnik vllm-cpu-avx512bf16
Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe... 3K
MekayelAnik vllm-cpu-avx512vnni
vLLM CPU inference engine (AVX512 + VNNI optimized) 3K
MekayelAnik vllm-cpu-amxbf16
Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe... 3K
MekayelAnik vllm-cpu-avx512
vLLM CPU inference engine (AVX512 optimized) 2K
vllm-project vllm-hust
A high-throughput and memory-efficient inference and serving engine for LLMs 437
vllm-project wxy-test
A high-throughput and memory-efficient inference and serving engine for LLMs 375
vllm-project ai-dynamo-vllm
A high-throughput and memory-efficient inference and serving engine for LLMs 344
vllm-project vllm-emissary
A high-throughput and memory-efficient inference and serving engine for LLMs 132
vllm-project vllm-usf
A high-throughput and memory-efficient inference and serving engine for LLMs 115
vllm-project vllm-test-tpu
A high-throughput and memory-efficient inference and serving engine for LLMs 80
vllm-project vllm-fixed
A high-throughput and memory-efficient inference and serving engine for LLMs 42