How to truncate a Bert tokenizer in Transformers library

前端 未结 0 831
执念已碎
执念已碎 2020-11-27 16:54

I am using the Scibert pretrained model to get embeddings for various texts. The code is as follows:

from transformers import *

tokenizer = AutoTokenizer.fro         


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题