Latency Python Packages

tcp-latency

Module and command-line tool to measure latency using TCP.

shredstream

Solana ShredStream SDK/Decoder for Python, enabling ultra-low latency Solana transaction streaming via UDP shreds from https://www.shredstream.com

osaca

Open Source Architecture Code Analyzer

llama

Library for testing and measuring network loss and latency between distributed endpoints.

dns-benchmark-tool

Fast, comprehensive DNS performance testing with DNSSEC validation, DoH/DoT support, and enterprise features.

infermark

LLM inference benchmarking toolkit. Measure TTFT, inter-token latency, throughput, and P50–P99 across concurrency levels.

latency-monitor

Daemon that acts as both client & server for monitoring latency between different endpoints

aioprox

aioprox – Asynchronous proxy manager for Python. Fetch, test, and filter HTTP/SOCKS proxies with optional latency measurement and custom sources.

vequil-sdk

Precision at the edge of information

lattice-transport

A complete transport layer for LLM traffic

connmonitor

Uses the connvitals library to continuously poll and record network connectivity statistics.

percently

A fast and efficient percentile calculator written in Rust.

vequil

Precision at the edge of information

voice-budget

The only voice agent context manager with a TTFT feedback loop

llcv

An Extensible Framework for Low-Latency Computer Vision Research :fast_forward:

pytorchures

Python profiler for pytorch models. Wraps each layer and measures it's execution time.

llmperf

Benchmarking tool for stress testing self-hosted LLMs, Azure OpenAI, and OpenAI APIs. Measure latency, throughput, and optimize performance. 🚀

hdr-plot

A simple standalone script to plot HdrHistograms directly from the output of wrk load testing tool

do-latency

🐳 Digital Ocean regions latency checker

modelping

⚡ Benchmark LLM, STT, and TTS inference latency across providers. Measure TTFT P50/P95/P99, full voice pipeline benchmarks, CI-ready.

peano

Measures python performance and reports to InfluxDB

nn-meter

A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

splleed

LLM inference benchmarking harness with pluggable backends

lltune

LLTune tunes Linux servers for ultra-low latency workloads. It scans system state, generates a config, audits for risks, applies safe CPU/ memory/network/kernel/IRQ tuning with backups and rollback, and stages persistence services for reboot.