Dependents of outlines

58 dependents

Package	Description	Downloads/month
sglang	SGLang is a high-performance serving framework for large language models and mul...	287.7M
mlx-openai-server	A high-performance API server that provides OpenAI-compatible endpoints for MLX ...	22K
optillm	Optimizing inference proxy for LLMs	12K
deepfabric	Curate High Quality Datasets, Train, Evaluate and Ship	7K
econsimulacra	This repository provides a simulation platform based on LLM agents grounded in m...	5K
logsentinelai	LLM-powered security log analyzer: detect threats & anomalies with zero regex — ...	5K
coreason-runtime	The official zero-trust, high-throughput kinetic execution engine for the coreas...	4K
sglang-kt	SGLang is a high-performance serving framework for large language models and mul...	4K
mlx-omni-server	MLX Omni Server is a local inference server powered by Apple's MLX framework, sp...	3K
sieves	Plug-and-play document AI with zero-shot models.	2K
truthtorchlm	TruthTorchLM is an open-source library designed to assess truthfulness in langua...	2K
agents-docs-sync	コミットするごとにテスト実行・ドキュメント生成・AGENTS.md の自動更新を行うパイプライン	1K
doctra	Parse, extract, and analyze documents with ease	1K
mosaicx	Medical cOmputational Suite for Advanced Intelligent eXtraction	811
gimkit	Guided Infilling Modeling Toolkit	713
nm-vllm	General Information, model certifications, and benchmarks for nm-vllm enterprise...	666
su-master-mind-llm	Sorbonne University Master MIND - Large Language Models course plugin	445
llm-vm	An Open-Source AGI Server for Open-Source LLMs	413
educhateval	A pipeline and package to implement and evaluate LLM chat bot tutors in educatio...	413
kraken-llm	Библиотека клиентов для взаимодействия с LLM	393
mlx-textgen	A python package for serving LLM on OpenAI-compatible API endpoints with prompt ...	364
outlines-haystack	Use `outlines` generators with Haystack.	359
text-albumentations	A simple library for generating instruction tuning datasets locally	358
vllm-xft	A high-throughput and memory-efficient inference and serving engine for LLMs	345
ai-dynamo-vllm	A high-throughput and memory-efficient inference and serving engine for LLMs	344
hinteval	A Python framework designed for both generating and evaluating hints.	301
neural-txt	Super fast local inferencing for common NLP tasks on technical text	296
nextai-vllm	A high-throughput and memory-efficient inference and serving engine for LLMs	273
autobiasdetector	tools for detecting bias patterns of LLMs	234
vllm-npu	A high-throughput and memory-efficient inference and serving engine for LLMs	209
power-sglang-cuda124	SGLang fork for ppc64le with CUDA 12.4 and Torch Triton support	186
mlxengine	Local MLX Engine	183
vllm-rocm	A high-throughput and memory-efficient inference and serving engine for LLMs	176
gec-metrics	A library for Grammatical Error Correction evaluation.	160
lll-simple-ai-service	Structured AI service with Outlines for JSON output	153
outlinesmlx	Probabilistic Generative Model Programming	138
json-repair-llm	A Python package for repairing broken JSON using multiple backends: LLMs and FSM...	133
vllm-emissary	A high-throughput and memory-efficient inference and serving engine for LLMs	132
fusellm	Train small LLMs and deploy them for fast structured extraction on CPU	127
langextract-outlines	Outlines custom provider plugin for LangExtract	121
open-autonlu	An open-source pipeline for training natural language understanding models	110
structurecontext	structre context for code project	110
struct-ie	A Python library for structured information extraction with LLMs.	109
codestory	A cli tool for generating conventional commit messages using LLM models	107
tilearn-infer	A high-throughput and memory-efficient inference and serving engine for LLMs	107
structuredcontext	structre context for code project	105
artisan-engine	A production-grade, OpenAI-compatible API layer for local LLMs with guaranteed s...	87
mseep-deepfabric	Large Scale Topic based Synthetic Data Generation for LLM Fine-Tuning & Training	83
vllm-test-tpu	A high-throughput and memory-efficient inference and serving engine for LLMs	80
gigax	Call LLM-powered NPCs from your game, at runtime.	79