In Bellman equation
where,
s = a particular state (room)
a = action (moving between the rooms)
s′ = state to which the robot goes from s
