Maybe I\'m rather stupid but I just can\'t find a satisfying answer: Using the KNN-algorithm, say k=5. Now I try to classify an unknown object by getting its 5 nearest neighbour
Maybe you can try fuzzy knn. For the choice of k I think lots of experiments should be done in order to get the best classification result.