How to create input states to feed into a neural network using TenserFlow?

Question

I have gotten a piece of code for actor-critic from Internet and trying to create my own input states and feed it into the actor-critic. The original input state that the co