Why my accuracy is saturating to a very low value in transfer learning?

Question

I am training a model for Optical Character Recognition of Gujarati Language using transfer learning. The input image is a character image. I have taken 37 classes.