I have been working on this VR website for my project for sometime. It used to be able to allow user to view left/right side of the virtual world by moving your phone to the
Try using firefox on android, or the built-in samsung internet app.
If everything works as expected, it means you've stumbled on a bug in the recent chrome build, described here, which should be fixed in the next build.
Also using the latest a-frame master build should solve the issue for now.