PyPI Stats

lm-format-enforcer

Packages that depend on this package
32 dependents
Package Description Downloads/month
vllm-project vllm
A high-throughput and memory-efficient inference and serving engine for LLMs 9.4M
vllm-project vllm-tpu
A high-throughput and memory-efficient inference and serving engine for LLMs 143K
MekayelAnik vllm-cpu
Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe... 31K
vllm-mlx vllm-mlx
vLLM-like inference for Apple Silicon - GPU-accelerated Text, Image, Video & Aud... 10K
aphrodite-engine aphrodite-engine
Large-scale LLM inference engine 7K
MekayelAnik vllm-cpu-avx512bf16
Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe... 3K
remichu-ai gallama
An opinionated Llama Server engine with a focus on agentic tasks 3K
MekayelAnik vllm-cpu-avx512vnni
vLLM CPU inference engine (AVX512 + VNNI optimized) 3K
MekayelAnik vllm-cpu-amxbf16
Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe... 3K
MekayelAnik vllm-cpu-avx512
vLLM CPU inference engine (AVX512 optimized) 2K
neuralmagic nm-vllm
General Information, model certifications, and benchmarks for nm-vllm enterprise... 666
vllm-project vllm-hust
A high-throughput and memory-efficient inference and serving engine for LLMs 437
vllm-project wxy-test
A high-throughput and memory-efficient inference and serving engine for LLMs 375
vllm-project vllm-xft
A high-throughput and memory-efficient inference and serving engine for LLMs 345
vllm-project ai-dynamo-vllm
A high-throughput and memory-efficient inference and serving engine for LLMs 344
lmfunctions
Python functions backed by language models 338
autobiasdetector
tools for detecting bias patterns of LLMs 234
vllm-project vllm-npu
A high-throughput and memory-efficient inference and serving engine for LLMs 209
vllm-project vllm-rocm
A high-throughput and memory-efficient inference and serving engine for LLMs 176
vllm-project vllm-emissary
A high-throughput and memory-efficient inference and serving engine for LLMs 132
vllm-project vllm-usf
A high-throughput and memory-efficient inference and serving engine for LLMs 115
qikahh structurecontext
structre context for code project 110
qikahh structuredcontext
structre context for code project 105
llama-index-prompt-utils-lmformatenforcer
llama-index prompts utils lmformatenforcer integration 95
llama-index-prompts-lmformatenforcer
llama-index prompts lmformatenforcer integration 94
llama-index-prompts-lmformatenforcer-utils
llama-index prompts lmformatenforcer utils integration 92
vllm-project vllm-test-tpu
A high-throughput and memory-efficient inference and serving engine for LLMs 80
flying-delta-prompts-lmformatenforcer
llama-index prompts lmformatenforcer integration 66
flying-delta-prompt-utils-lmformatenforcer
llama-index prompts utils lmformatenforcer integration 65
structured-output-kit
Add your description here 59
vllm-project vllm-fixed
A high-throughput and memory-efficient inference and serving engine for LLMs 42
etched-ai etched-blitz
A high-throughput and memory-efficient inference and serving engine for LLMs 41