How to turn the blogpost A3C Cartpole model into a multi layer model?

Question

Went to post this question on GitHub, but was directed here for help. It\'s a bit of a general question, but pertaining to the A3C Blogpost article here, how could one poten