Gymnasium: A Standard Interface for Reinforcement Learning Environments

Markus Krimmel (Max Planck Institute of Biochemistry) · J Terry (University of Maryland College Park (SSO)) · Mark Towers (Anyscale) · Ariel Kwiatkowski (Facebook) · John Balis (University of Wisconsin - Madison) · Gianluca De Cola (---) · Tristan Deleu (Entalpic) · Manuel Goulão (INESC-ID) · Kallinteris Andreas (Technical University of Crete) · Arjun KG (Earthbrain Inc.) · Rodrigo Perez-Vicente (Farama Foundation) · Andrea Pierré (University of Massachusetts at Lowell) · Sander Schulhoff (University of Maryland, College Park) · Jun Jet Tai (Coventry University) · Hannah Tan · Omar G. Younis (ETH Zurich)

abstractionsalgorithm implementationsapicustomizationenvironmentsinnovationinteroperabilityopen-source library reinforcement learning reproducibilityresearch progressrobustnessstandardizationtestingtraining algorithms unified framework

Reinforcement Learning (RL) is a continuously growing field that has the potential to revolutionize many areas of artificial intelligence. However, despite its promise, RL research is often hindered by the lack of standardization in environment and algorithm implementations. This makes it difficult for researchers to compare and build upon each other's work, slowing down progress in the field.Gymnasium is an open-source library that provides a standard API for RL environments, aiming to tackle this issue. Gymnasium's main feature is a set of abstractions that allow for wide interoperability between environments and training algorithms, making it easier for researchers to develop and test RL algorithms. In addition, Gymnasium provides a collection of easy-to-use environments, tools for easily customizing environments, and tools to ensure the reproducibility and robustness of RL research.Through this unified framework, Gymnasium significantly streamlines the process of developing and testing RL algorithms, enabling researchers to focus more on innovation and less on implementation details. By providing a standardized platform for RL research, Gymnasium helps to drive forward the field of reinforcement learning and unlock its full potential. Gymnasium is available online at \url{https://github.com/Farama-Foundation/Gymnasium}.