FourRooms

The FourRooms domain is a continuous state domain where the agent navigates a ball through a set of obstacles to reach the main goal. The environment uses a four-dimensional state representation of positions and velocities, (x, y, ˙x, ˙y) ∈ [0, 1] × [0, 1] × [−2, 2] × [−2, 2].