1
$\begingroup$

For polynomial fitting with a polynomial of degree $n$, we have $n$ degrees of freedom. Is there a similar concept for $k$ nearest neighbors? Is there any way to compare the degrees in general? I come from an EE background so I might not familiar with some of the advanced terminology.

$\endgroup$
  • 4
    $\begingroup$ Polynomials of degree $n$ have $n+1$ d.f. $\endgroup$ – Glen_b -Reinstate Monica Feb 20 '13 at 5:25
1
$\begingroup$

It is roughly $N/k$ where $N$ is the number of data points. See here: http://en.wikipedia.org/wiki/Degrees_of_freedom_(statistics) http://www.cs.ubc.ca/~murphyk/Teaching/CS340-Fall07/L4_knn.pdf

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.