Accuracy is not increasing over 40% . Why?

Question

I am trying to build a multi class classification algorithm having 37 classes. Each class consists of less than 100 images and more than 70 . I am using CNN for training and