Code
Source code for some results in my publications.
Robust Markov Decision Processes
A C++ library for solving robust Markov decision processes. It also provides functionality for implementing simple MDP-based stochastic simulators. Can be used as a basis for reinforcement learning algorithms.
Robust Aggregation for MDPs
A Python library for simulating and solving large MDPs via an approximation by robust MDPs. Implements several old and new benchmark domains.