OpenAI gym's breakout-v0 “pauses”

倖福魔咒の 提交于 2021-02-08 21:48:24

问题


While training in the OpenAI gym environment I have the idea that the environment sometimes "stops". For many frames in a row no ball is visible/stops spawning.

Is this an error in the gym environment? Is this something that is part of the game Breakout-v0?

I was also wondering what the possible actions are in Breakout-v0. What I kind of figured out:

0 - do nothing/stand still?

1 - do nothing/stand still?

2 - apply "force" to the right?

3 - apply "force" to the left?

Edit: For people wondering what I'm talking about: see this gif: http://imgur.com/a/pBLGX The transition between 5 and 4 lives takes a lot of frames... Sometimes the break is even longer than this...


回答1:


Its cause after end of life your agent needs to hit the fire button to get the game to start playing again. If it doesn't learn to do this then the game will not progress and looked paused like you say it seems.

I believe actions off the top of my head are:

0: no-op 1: fire 2: right 3: left

could be other way around on directions



来源:https://stackoverflow.com/questions/44777068/openai-gyms-breakout-v0-pauses

标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!