The validation tag has no wiki summary.
12
votes
3answers
7k views
What is the difference between test set and validation set?
I found this confusing when I use the neural network toolbox in Matlab.
It divided the raw data set into three parts:
training set
validation set
test set
I notice in many training or learning ...
6
votes
2answers
654 views
What is the procedure for “bootstrap validation” (a.k.a. “resampling cross-validation”)?
"Bootstrap validation"/"resampling cross-validation" is new to me, but was discussed by the answer to this question. I gather it involves 2 types of data: the real data and simulated data, where a ...
16
votes
2answers
1k views
How to draw valid conclusions from “big data”?
"Big data" is everywhere in the media. Everybody says that "big data" is the big thing for 2012, e.g. KDNuggets poll on hot topics for 2012. However, I have deep concerns here. With big data, ...
4
votes
1answer
648 views
Best practices for measuring and avoiding overfitting?
I am developing automated trading systems for the stock market. The big challenge has been overfitting. Can your recommend some resources describing methods for measuring and avoiding overfitting?
I ...
1
vote
2answers
919 views
What is a consistency check?
I was asked such a question as "Did you do any consistency check in your daily work?" during a phone interview for a Biostatistician position. I don't know what to answer. Any information is ...
