The Average Distance Classifier is a simplified version of the Nearest Neighbour classifier. It is really easy to implement compared to other classification algorithms. Because it discards a lot of the data given to it, its accuracy can be worse than other classifiers. The algorithm can be thought of as a nearest-neighbor where each label is a single neighbor.

Comparison with Nearest-Neighbor