I want to utilize not only the feature-extractor pre-trained weights but also the feature-map layers\' classifier/localization pre-trained weights for fine-tuning tensorflow
As I read through the code I found the responsible code, which only retains the pre-trained model's weights if the shape of the layers between the newly-defined model and the pre-trained model match. So if I change the number of the class, the shape of the classifier layers change, and the pre-trained weights are not retained.
https://github.com/tensorflow/models/blob/master/research/object_detection/utils/variables_helper.py#L133