nltk stemmer: string index out of range

Question

I have a set of pickled text documents which I would like to stem using nltk\'s PorterStemmer. For reasons specific to my project, I would like to do the stemming i

Answer 1

This is an NLTK bug specific to NLTK version 3.2.2, for which I am to blame. It was introduced by PR https://github.com/nltk/nltk/pull/1261 which rewrote the Porter stemmer.

I wrote a fix which went out in NLTK 3.2.3. If you're on version 3.2.2 and want the fix, just upgrade - e.g. by running

pip install -U nltk