conll

问题 I have a dataset in CoNLL NER format which is basically a TSV file with two fields. The first field contains tokens from some text - one token per line (each punctuation symbol is also considered a token there) and the second field contains named entity tags for tokens in BIO format. I would like to load this dataset into spaCy, infer new named entity tags for the text with my model and write these tags into the same TSV file as the new third column. All I know is that I can infer named

问题 I have a dataset in CoNLL NER format which is basically a TSV file with two fields. The first field contains tokens from some text - one token per line (each punctuation symbol is also considered a token there) and the second field contains named entity tags for tokens in BIO format. I would like to load this dataset into spaCy, infer new named entity tags for the text with my model and write these tags into the same TSV file as the new third column. All I know is that I can infer named

问题 Where can I find an example .conllu file Spacy will accept ? or example how to generate it ? with IOB ? Trying to convert .conllu file I generated to .json for model training, this way : head_ix = token.head.i - sent[0].i + 1 conll.append( (str(i), token.orth_, token.lemma_, token.tag_, token.ent_type_, str(head_ix), token.dep_) ) (Do you have correct example of doing this ) here is the error : $ python -m spacy convert spt3.conllu ....... File "/usr/local/lib/python2.7/dist-packages/spacy

问题 Where can I find an example .conllu file Spacy will accept ? or example how to generate it ? with IOB ? Trying to convert .conllu file I generated to .json for model training, this way : head_ix = token.head.i - sent[0].i + 1 conll.append( (str(i), token.orth_, token.lemma_, token.tag_, token.ent_type_, str(head_ix), token.dep_) ) (Do you have correct example of doing this ) here is the error : $ python -m spacy convert spt3.conllu ....... File "/usr/local/lib/python2.7/dist-packages/spacy