I am running the imagenet from TensorFlow models repository. I\'ve instrumented sess.run as described in Github comment and got the following view in the chrome://tracing
I found existing answer to this question. All cores are wrapped in cpu:0, i.e., TensorFlow does indeed use multiple CPU cores by default.