$k$-Nearest-Neighbor Classifiers These classifiers are memory-based, and require no model to be fit. Given a query point $x_0$, we find the $k$ training points $x(r), r = 1,...,k$ closest in distance to $x_0$, and then classify using majority vote among the $k$ neighbors.