I need to parse sentences from a paragraph in Python. Is there an existing package to do this, or should I be trying to use regex here?
Here is how I am getting the first n sentences:
def get_first_n_sentence(text, n):
endsentence = ".?!"
sentences = itertools.groupby(text, lambda x: any(x.endswith(punct) for punct in endsentence))
for number,(truth, sentence) in enumerate(sentences):
if truth:
first_n_sentences = previous+''.join(sentence).replace('\n',' ')
previous = ''.join(sentence)
if number>=2*n: break #
return first_n_sentences
Reference: http://www.daniweb.com/software-development/python/threads/303844
The nltk.tokenize module is designed for this and handles edge cases. For example:
>>> from nltk import tokenize
>>> p = "Good morning Dr. Adams. The patient is waiting for you in room number 3."
>>> tokenize.sent_tokenize(p)
['Good morning Dr. Adams.', 'The patient is waiting for you in room number 3.']