nltk wordpunct_tokenize vs word_tokenize

Question

Does anyone know the difference between nltk\'s wordpunct_tokenize and word_tokenize? I\'m using nltk=3.2.4 and there\'s noth

Answer 1

Word_tokenize is for tokenizing a word in a sentence while wordpunct_tokenize is to remove the non-English words in a sentence.