Search Packages

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-R1, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

hud-python

OSS RL environment + evals toolkit

qwen3-embed

Lightweight ONNX inference for Qwen3 embedding and reranking models

nemo-automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

steadytext

Deterministic text generation and embeddings with zero configuration

deepsearcher

None

obsidian-umbra

Turn any Obsidian vault into a Zettelkasten graph — locally, with a dozen years of notes in minutes. 4-phase pipeline: daily splitter (Qwen3-4B) → semantic backlinks (Potion-32M) → keyword linker → synonym clustering (GTE-large + HDBSCAN). Zero cloud.

german-ocr

High-performance German document OCR - Local & Cloud with GPU/CPU support

vllm-hust

A high-throughput and memory-efficient inference and serving engine for LLMs

ggufloader

GGUF Loader with its Agentic Mode, and floating button, ai Models | Open Source & Offline. Mistral, Deepseek, llama, gemma, qwen

wxy-test

A high-throughput and memory-efficient inference and serving engine for LLMs

kakeyalattice

Discrete Kakeya cover for LLM KV cache: D4/E8 nested-lattice quantisation realising a Kakeya-style tube-cover over the direction sphere. 2.4x-2.8x compression at <1% perplexity loss on Qwen3, Llama-3, DeepSeek, GLM-4, Gemma. Drop-in transformers.DynamicCache. pip install kakeyalattice.

vllm-xft

A high-throughput and memory-efficient inference and serving engine for LLMs

ai-dynamo-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-acc

A high-throughput and memory-efficient inference and serving engine for LLMs

nextai-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

metascreener

Open-source multi-LLM ensemble tool for systematic review workflows

vllm-consul

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-npu

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-musa

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-rocm

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-emissary

A high-throughput and memory-efficient inference and serving engine for LLMs