Search Packages

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

pyopencl

OpenCL integration for Python, plus shiny features

dstack

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

lmcache

Supercharge Your LLM with the Fastest KV Cache Layer

conch-triton-kernels

A "standard library" of Triton kernels.

amd-gaia

Build AI agents for your PC

amdfan

Updated AMD Fan control utility forked from amdgpu-fan and updated.

grilly

GPU-accelerated neural network operations using Vulkan compute shaders

uccl

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

eyepie

A python package to read, analyse and visualize OCT and fundus data from various sources.

l9gpu

GPU telemetry with workload attribution. One OTLP agent per node ties hardware metrics (NVIDIA, AMD, Intel Gaudi) to the K8s pod or Slurm job burning the GPU — so you know who's paying for that idle H100.

nabla-ml

Nabla: High-Performance Scientific Computing

eyepy

A python package to read, analyse and visualize OCT and fundus data from various sources.

gputop

A simple real-time GPU monitoring tool for NVIDIA, AMD and Intel GPUs.

onnx-web

web UI for running ONNX models

vllm-hust

A high-throughput and memory-efficient inference and serving engine for LLMs

wxy-test

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-xft

A high-throughput and memory-efficient inference and serving engine for LLMs

ai-dynamo-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-acc

A high-throughput and memory-efficient inference and serving engine for LLMs

nextai-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

gpuctl

GPU contorl and failure notification/recovery

vllm-consul

A high-throughput and memory-efficient inference and serving engine for LLMs