GridBall
The GridBall domain is similar to the FourRooms domain, but change to be more like a grid-world to facilitate visualization. The velocity components of the state are removed, meaning the state only consists of (x, y) locations, and the action space is changed to displace the ball by a fixed amount in each cardinal dimension.
BibTex: