Do BERT's weight get updated during the fine-tuning process with PyTorch and TensorFlow?

Question

My question is whether or not BERT-base\'s weights are frozen by default when fine-tuning with PyTorch and TensorFlow, or are the base model\'s weights continually updating duri