Gymnasium Python Packages

pettingzoo

An API standard for multi-agent reinforcement learning environments, with popular reference environments and related utilities

shimmy

An API conversion tool for popular external reinforcement learning environments

skrl

Modular Reinforcement Learning (RL) library (implemented in PyTorch, JAX, and NVIDIA Warp) with support for Gymnasium/Gym, NVIDIA Isaac Lab, MuJoCo Playground and other environments

gymnasium-robotics

A collection of robotics simulation environments for reinforcement learning

minari

A standard format for offline reinforcement learning datasets, with popular reference datasets and related utilities

craftground

⚡⚡ Lightning Fast (~300TPS) Reinforcement Learning environment on latest Minecraft 🏝️

mo-gymnasium

Multi-objective Gymnasium environments for reinforcement learning

nextstat

High-performance statistical inference engine — MLE, Bayesian, survival, GLM, time series. Rust core with Python bindings.

stable-retro

Retro games for Reinforcement Learning Research

imitation

Clean PyTorch implementations of imitation and reward learning algorithms

sumo-rl

Reinforcement Learning environments for Traffic Signal Control with SUMO. Compatible with Gymnasium, PettingZoo, and popular RL libraries.

actorch

Deep reinforcement learning framework for fast prototyping based on PyTorch

crosslearn

Reusable representation extractors for reinforcement learning across vectors, images, and Chronos-backed time-series windows.

pyrddlgym

A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.

rtgym

Easily implement custom Gymnasium environments for real-time applications

remoterl

RemoteRL: high-performance command-line & Python client with pre-compiled native wheels for remote reinforcement-learning workloads.

unienv

Framework unifying robot environments and data APIs

deltatau-audit

Time Robustness Audit for RL agents — measures timing reliance, deployment robustness, and stress resilience

gymnasium-sudoku

A Sudoku environment for Reinforcement Learning research

rddlrepository

Hosts domain and instance RDDL files, covering problems from a wide range of disciplines, integration with the pyRDDLGym ecosystem.

openrl

unified reinforcement learning framework

mobile-env

An open, minimalist Gymnasium environment for autonomous coordination in wireless mobile networks.

ns-gym

A framework for modeling non-stationary Markov decision processes and the key decision making problems in these environments

parallelcbf

Composable safety-filter and auditability layer for tensor-parallel reinforcement learning. CBF safety filters, watchdog registries, pre-registration artifacts, failure forensics.