Low training and validation loss but also low mAP on Faster R-CNN on Mapillary dataset

Question

I am new to deep learning, I\'m using the Tensorflow 2 object detection API to fine-tune a Faster R-CNN model (pretrained on COCO 2017 dataset) on the Mapillary dataset to d