PyPI Stats
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About
Home

Search Packages

Find Python packages by name, description, GitHub topic, or filter by metrics
ModelEngine-Group
uc-manager

Persist and reuse KV Cache to speedup your LLM.

7K 274 73
vllm-project
vllm-ascend

Community maintained hardware plugin for vLLM on Ascend

7K 2K 1K
nndeploy
nndeploy

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

7K 2K 214
FlyTOmeLight
llm-cal

LLM inference hardware calculator — architecture-aware (MLA/NSA/MoE), engine-aware (vLLM/SGLang), honest-labeled. Reads real safetensors bytes; supports 53 GPUs (NVIDIA / AMD / Huawei Ascend / 沐曦 / 昆仑芯 / 壁仞 / 寒武纪 / 海光).

1K 1 0
datawhalechina
torch-rechub

A lightweight, efficient, and easy-to-use PyTorch recommendation system framework.

1K 1K 140
youyve
ascend-nputop

An interactive Ascend-NPU process viewer.

367 129 11
vllm-project
cmq-test

vLLM Ascend backend plugin

36 2K 1K
    • Data from PyPI, GitHub, ClickHouse, and BigQuery