I have built a bit complex model using pretrained BERT weights. The model structure is as follows:
Model: "model_1" ____________________________________