How to mix tensorflow keras model and transformers

Question

I am trying to import a pretrained model from Huggingface\'s transformers library and extend it with a few layers for classification using tensorflow keras. When I directly