Benchmark Framework Python Packages

pytest-django-queries

Generate performance reports from your django database performance tests.

32K 83 2

holobench

A package for benchmarking the characteristics of arbitrary functions

18K 4 3

cirq-superstaq

https://superstaq.readthedocs.io

15K 117 23

general-superstaq

https://superstaq.readthedocs.io

15K 117 23

qiskit-superstaq

https://superstaq.readthedocs.io

12K 117 23

benchexec

BenchExec: A Framework for Reliable Benchmarking and Resource Measurement

9K 281 223

checks-superstaq

https://superstaq.readthedocs.io

8K 117 23

supermarq

https://superstaq.readthedocs.io

8K 117 23

langtest

Pacific AI provides a library for delivering safe & effective NLP models.

3K 556 49

timeeval

Evaluation Tool for Anomaly Detection Algorithms on Time Series

2K 157 19

pyrddlgym

A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.

2K 93 23

banana-hep

Benchmarking AgaiNst Apfel aNd Anything

2K 2 1

nlptest

Deliver safe & effective language models

2K 556 49

lakebench

A multi-modal Python library for benchmarking Azure lakehouse engines and ELT scenarios, supporting both industry-standard and novel benchmarks.

1K 51 17

bayesmark

Benchmark framework to easily compare Bayesian optimization methods on real machine learning tasks

1K 160 36

tne-sdk

TNE-SDK - The Official Python SDK for The Null Epoch - an AI-only MMO where LLMs play autonomously. Connect any model (OpenAI, Anthropic, Ollama, vLLM, etc.) via MCP, TUI launcher, or raw HTTP. Includes memory, reflection, and agent orchestration for persistent AI gameplay/benchmarking.

1K 6 1

apolien

AI Safety Evaluation Library

1K 5 1

running-ng

Running next generation

1K 5 9

enfobench

Energy forecast benchmarking toolkit.

662 15 5

mlip-arena

🌟 [NeurIPS '25 Spotlight] Fair and transparent benchmark of machine learning interatomic potentials (MLIPs), beyond basic error metrics https://openreview.net/forum?id=SAT0KPA5UO

432 99 9