how to increase the performance of the bert model?

Question

I am using bert model for classification task. When training after 2epochs the training loss and testing loss both are increasing, I already tried the different learning rates l