Gpu Monitoring Python Packages

openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

jetson-stats

📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

hardview

A hardware monitoring project that provides high-performance tools, Python libraries, and C++ header files for retrieving and displaying detailed hardware information.

telescope-ui

Real-time visualization dashboard for LLM training runs

sollol

Super Ollama Load Balancer - Performance-aware routing for distributed Ollama deployments with Ray, Dask, and adaptive metrics

stormlog

A comprehensive GPU memory profiler for PyTorch and TensorFlow with CLI, visualization, and analytics

kempnerpulse

Real-time GPU monitoring dashboard for DCGM Prometheus metrics

nvitop-exporter

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

modaltrace

OpenTelemetry observability for real-time AI video pipelines

triage-runner

Script running tool for optimizing GPU memory utilization

l9gpu

GPU telemetry with workload attribution. One OTLP agent per node ties hardware metrics (NVIDIA, AMD, Intel Gaudi) to the K8s pod or Slurm job burning the GPU — so you know who's paying for that idle H100.

gpuview

A lightweight web dashboard for monitoring GPU usage

rickslab-gpu-utils

A set of utilities for monitoring and customizing GPU performance

nvsonar

Active GPU diagnostic tool that identifies performance bottlenecks

wattameter

Python package for monitoring and recording power usage, energy consumption, and performance metrics from hardware components such as GPUs and CPUs

gpu-overseer

Telegram notifier for GPU availability status.

gpusitter

Watch for idle GPUs and run your jobs: launches jobs in tmux, keeps logs/status and sends start/finish emails..

jetson-stats-customized

📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

cordatus-jtop-service

Interactive system-monitor and process viewer for all NVIDIA Jetson [Orin, Xavier, Nano, TX] series

nvitop-musa

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

cuda-selector

A simple tool to select the optimal CUDA device based custom criteria.

gpu-memory-profiler

Deprecated package alias for Stormlog. Install 'stormlog' instead.

picomon

Beautiful TUI dashboard for monitoring GPUs (AMD, NVIDIA, Apple Silicon)