Hello Stackoverflow community!
So Google has putout this pre-trained Bert model: https://github.com/google/patents-public-data/blob/master/examples/BERT_For_Patents.i