Tokenizing without breaking up key phrases

前端 未结 0 1018
梦毁少年i
梦毁少年i 2021-02-07 02:03

I have a string of text like s = \'hi, welcome to grade 3\'

currently when I tokenize the string I get

tokens = [\'hi\', \'welcome\', \'to\', \'

相关标签:
回答
  • 消灭零回复
提交回复
热议问题