text classification methods? SVM and decision tree

Question

i have a training set and i want to use a classification method for classifying other documents according to my training set.my document types are news and categories are sports

Answer 1

Linear SVMs are one of the top algorithms for text classification problems (along with Logistic Regression). Decision Trees suffer badly in such high dimensional feature spaces.

The Pegasos algorithm is one of the simplest Linear SVM algorithms and is incredibly effective.

EDIT: Multinomial Naive bayes also works well on text data, though not usually as well as Linear SVMs. kNN can work okay, but its an already slow algorithm and doesn't ever top the accuracy charts on text problems.