Word Prediction algorithm

Question

I\'m sure there is a post on this, but I couldn\'t find one asking this exact question. Consider the following:

1. We have a word dictionary available
2. We are

Answer 1

Yeh Whye Teh also has some recent interesting work that addresses this problem. The "Sequence Memoizer" extends the traditional prediction-by-partial-matching scheme to take into account arbitrarily long histories.

Here is a link the original paper: http://www.stats.ox.ac.uk/~teh/research/compling/WooGasArc2011a.pdf

It is also worth reading some of the background work, which can be found in the paper "A Bayesian Interpretation of Interpolated Kneser-Ney"