Search Packages

optimum-rbln

⚡ A seamless integration of HuggingFace Transformers & Diffusers with RBLN SDK for efficient inference on RBLN NPUs.

device-smi

Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separate tools such as nvidia-smi or /proc/cpuinfo and parsing it yourself.

uc-manager

Persist and reuse KV Cache to speedup your LLM.

rockchip-stats

Rockchip Device Monitoring Tool

mblt-tracker

A Python library to track device usage, such as Mobilint NPU, NVIDIA GPU, Intel CPU, ...

torch-rechub

A lightweight, efficient, and easy-to-use PyTorch recommendation system framework.

maixtool

C/C++ development kit for Sipeed Maix ecosystem boards

rk-transformers

Export and Run Hugging Face Transformers Models on Rockchip NPUs

ascend-nputop

An interactive Ascend-NPU process viewer.

vimin-core

Open-source local AI inference orchestration. Run open-source LLMs across a fleet of machines - no cloud, no API keys.

rknn-inspect

rknn-inspect shows model structure, ops, inputs and outputs, and performance information about rknn models.

nexil

Local LLM chat assistant for Intel hardware via OpenVINO

pai-sdk

Open-source AI wearable companion. Local-first multimodal perception (VLM & Audio) on Edge NPU. Built with Rust & Flutter.

maixcdk-example

C/C++ development kit for Sipeed Maix ecosystem boards

jllm

Running Large Language Model easily.

maixcdk

C/C++ development kit for Sipeed Maix ecosystem boards