Qwen3 Python Packages

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-R1, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

hud-python

OSS RL environment + evals toolkit

qwen3-embed

Lightweight ONNX inference for Qwen3 embedding and reranking models

nemo-automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

steadytext

Deterministic text generation and embeddings with zero configuration

taiwan-asr-toolkit

Production-grade Traditional Chinese / Taiwan Mandarin speech-to-text. Qwen3-ASR + MediaTek Breeze-ASR-25, hot-word injection, LLM polish, speaker diarization. RTF up to 1554x on RTX 5090, 56 TDD tests.

obsidian-umbra

Turn any Obsidian vault into a Zettelkasten graph — locally, with a dozen years of notes in minutes. 4-phase pipeline: daily splitter (Qwen3-4B) → semantic backlinks (Potion-32M) → keyword linker → synonym clustering (GTE-large + HDBSCAN). Zero cloud.

deepsearcher

None

vllm-xft

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-acc

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-hust

A high-throughput and memory-efficient inference and serving engine for LLMs

ggufloader

GGUF Loader with its Agentic Mode, and floating button, ai Models | Open Source & Offline. Mistral, Deepseek, llama, gemma, qwen

german-ocr

High-performance German document OCR - Local & Cloud with GPU/CPU support

ai-dynamo-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

wxy-test

A high-throughput and memory-efficient inference and serving engine for LLMs

kakeyalattice

Discrete Kakeya cover for LLM KV cache: D4/E8 nested-lattice quantisation realising a Kakeya-style tube-cover over the direction sphere. 2.4x-2.8x compression at <1% perplexity loss on Qwen3, Llama-3, DeepSeek, GLM-4, Gemma. Drop-in transformers.DynamicCache. pip install kakeyalattice.

nextai-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-consul

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-npu

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-musa

A high-throughput and memory-efficient inference and serving engine for LLMs

metascreener

Open-source multi-LLM ensemble tool for systematic review workflows

vllm-emissary

A high-throughput and memory-efficient inference and serving engine for LLMs