Dependents of mistral-common

55 dependents

Package	Description	Downloads/month
sglang	SGLang is a high-performance serving framework for large language models and mul...	287.7M
vllm	A high-throughput and memory-efficient inference and serving engine for LLMs	9.4M
vllm-tpu	A high-throughput and memory-efficient inference and serving engine for LLMs	143K
vllm-cpu	Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe...	31K
mistral-inference		24K
axolotl	Go ahead and axolotl questions	20K
tensorrt-llm	TensorRT LLM provides users with an easy-to-use Python API to define Large Langu...	16K
vox-voxtral	Mistral Voxtral STT/TTS adapter for Vox	15K
scandeval	The robust European language model benchmark.	13K
aphrodite-engine	Large-scale LLM inference engine	7K
euroeval	The robust European language model benchmark.	5K
vllm-cpu-avx512bf16	Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe...	3K
neurobrix	Universal Deep Learning Inference Engine — execute any AI model without model-sp...	3K
nemo-automodel	🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Fa...	3K
vllm-cpu-avx512vnni	vLLM CPU inference engine (AVX512 + VNNI optimized)	3K
cirilla	Crilla is a simple way to introduce optimized single-GPU training into your proj...	3K
vllm-cpu-amxbf16	Wheels & Docker images for running vLLM on CPU-only systems, optimized for diffe...	3K
faster-whisper-hotkey	Push-to-talk transcription	2K
vllm-cpu-avx512	vLLM CPU inference engine (AVX512 optimized)	2K
ontolearner	OntoLearner: A Modular Python Library for Ontology Learning with LLMs https://py...	2K
dbc-gptcli	A CLI client meant to provide the core features of the ChatGPT and Le Chat weba...	2K
toolagents	ToolAgents is a lightweight and flexible framework for creating function-calling...	2K
autobyteus	Multi-Agent framework	2K
llm-annotator	An easy-to-extend LLM annotator for robust, resumable data annotation.	901
avise	AI Vulnerability Identification & Security Evaluation framework	881
nm-vllm	General Information, model certifications, and benchmarks for nm-vllm enterprise...	666
schema-miner	A Human-in-the-Loop Workflow for Scientific Schema Mining with Large Language Mo...	640
cjm-transcription-plugin-voxtral-hf	Mistral Voxtral plugin for the cjm-transcription-plugin-system library - provide...	602
cjm-transcription-plugin-voxtral-vllm	Mistral Voxtral plugin for the cjm-transcription-plugin-system library - provide...	546
vllm-kunlun	vLLM Kunlun3 backend plugin	464
tinygent-mistralai		455
mlx-voxtral	Voxtral audio processing and model implementation for Apple Silicon using MLX	438
vllm-hust	A high-throughput and memory-efficient inference and serving engine for LLMs	437
multimodal-parsers	PDF processing pipeline: remove headers/footers, convert to markdown, and genera...	410
hexamind	Hexamind library to implement RAG solutions	402
wxy-test	A high-throughput and memory-efficient inference and serving engine for LLMs	375
ai-dynamo-vllm	A high-throughput and memory-efficient inference and serving engine for LLMs	344
kalle	A smart CLI friend	313
clean-transcribe	A simple CLI to transcribe Youtube videos or local audio/video files and produce...	264
mistral-sae	Sparse AutoEncoder to decode Mistral LLM	262
voxmlx	Voxtral Mini Realtime speech-to-text in MLX	256
orpheus-r	Add your description here	198
unitrust	Slimmed release mirror of UniTrust for AEN and TruthPrInt.	192
vllm-rocm	A high-throughput and memory-efficient inference and serving engine for LLMs	176
git-autocommit-hook	Automatically generate commit messages from changes	172
auk-scrapegraphai	A web scraping library based on LangChain which uses LLM and direct graph logic ...	150
vllm-emissary	A high-throughput and memory-efficient inference and serving engine for LLMs	132
vllm-usf	A high-throughput and memory-efficient inference and serving engine for LLMs	115
ai-companion-llm-backend	Add your description here	94
infinity-llm	use any llm api in a plug-and-play fashion	92