Tagged Questions
0
votes
0answers
37 views
Overfitting in K-NN and Decision Trees?
To avoid over fitting for K-NN could you increase the value of K to reduce anomalous results etc. However, if the value of K is very large with respect to a sample, would this also incur in over ...
0
votes
0answers
39 views
How to calculate entropy in log Scale?
I'm working on a problem , where a function returns the Log probability of P(X=x) . Now I would like to find the Entropy of X. But since the probabilities I get are log probabilities, again taking its ...
7
votes
1answer
2k views
Clustering: Should I use the Jensen-Shannon Divergence or its square?
I am clustering probability distributions using the Affinity Propagation algorithm, and I plan to use Jensen-Shannon Divergence as my distance metric.
Is it correct to use JSD itself as the distance, ...
