PyPI Stats

llguidance

Packages that depend on this package
26 dependents
Package Description Downloads/month
sgl-project sglang
SGLang is a high-performance serving framework for large language models and mul... 287.7M
vllm-project vllm
A high-throughput and memory-efficient inference and serving engine for LLMs 9.4M
vllm-project vllm-tpu
A high-throughput and memory-efficient inference and serving engine for LLMs 143K
guidance-ai guidance
A guidance language for controlling large language models. 34K
MekayelAnik vllm-cpu
Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe... 31K
NVIDIA tensorrt-llm
TensorRT LLM provides users with an easy-to-use Python API to define Large Langu... 16K
aphrodite-engine aphrodite-engine
Large-scale LLM inference engine 7K
sgl-project sglang-kt
SGLang is a high-performance serving framework for large language models and mul... 4K
MekayelAnik vllm-cpu-avx512bf16
Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe... 3K
MekayelAnik vllm-cpu-avx512vnni
vLLM CPU inference engine (AVX512 + VNNI optimized) 3K
MekayelAnik vllm-cpu-amxbf16
Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe... 3K
MekayelAnik vllm-cpu-avx512
vLLM CPU inference engine (AVX512 optimized) 2K
infly-ai infinity-parser2
INF Tech's open-source MLLMs for SOTA visual-language understanding and advanced... 1K
SculptAI gimkit
Guided Infilling Modeling Toolkit 713
vllm-kunlun
vLLM Kunlun3 backend plugin 464
vllm-project vllm-hust
A high-throughput and memory-efficient inference and serving engine for LLMs 437
mlx-vlm-batch-outlines
Qwen-focused MLX vision-language chat library with batched multimodal chat. 410
vllm-project wxy-test
A high-throughput and memory-efficient inference and serving engine for LLMs 375
vllm-project ai-dynamo-vllm
A high-throughput and memory-efficient inference and serving engine for LLMs 344
guidance-ai guidance-lark-mcp
MCP server with tools to build lark grammars compatible with llguidance 224
RomanMoz power-sglang-cuda124
SGLang fork for ppc64le with CUDA 12.4 and Torch Triton support 186
vllm-project vllm-emissary
A high-throughput and memory-efficient inference and serving engine for LLMs 132
vllm-project vllm-test-tpu
A high-throughput and memory-efficient inference and serving engine for LLMs 80
LargeLorisModels casa-lm
Constrained sampling for language models. 70
vllm-project vllm-fixed
A high-throughput and memory-efficient inference and serving engine for LLMs 42
sgl-project sglang-cpu
SGLang is a fast serving framework for large language models and vision language... 2