apostrophe turning into \x92

前端 未结 1 1657
难免孤独
难免孤独 2021-02-19 15:28

mycorpus.txt

Human where\'s machine interface for lab abc computer applications   
A where\'s survey of user opinion of computer system response         


        
1条回答
  •  独厮守ぢ
    2021-02-19 16:13

    Code point 92(hex) in window-1252 encoding is Unicode code point 2019(hex) which is 'RIGHT SINGLE QUOTATION MARK'. This looks very like an apostrophe and is likely to be the actual character that you have in stopwords.txt, which I've guessed from the way python has interpreted in, has be encoded in windows-1252 or an encoding that shares ASCII and codepoint values.

    ' vs ’

    0 讨论(0)
提交回复
热议问题