I will be working on an implementation of DQNs and recent extensions from Google DeepMind in Caffe.
For this I will write a simulator (in place of the Atari emulator) fo
IMHO, it is better to use python to interface with caffe.
From my understanding caffe developers and community intend on developing the python interface more than the matlab one. One such direction is allowing for a net to be constructed purely in python (not using prototxt file at all), you can see such an example in this question.