One of the main way to overcome overfitting is using $K$ fold cross-validation, and as this paragraph in cross-validation wiki page says: > The goal of cross-validation is to estimate the expected level of fit of a model to a data set that is independent of the data that were used to train the model. It can be used to estimate any quantitative measure of fit that is appropriate for the data and model. For example, for binary classification problems, each case in the validation set is either predicted correctly or incorrectly. In this situation the misclassification error rate can be used to summarize the fit, although other measures like positive predictive value could also be used. When the value being predicted is continuously distributed, the mean squared error, root mean squared error or median absolute deviation could be used to summarize the errors. Somewhere I read if all $K$ repeats of training and evaluating the model give nearly the same performance this indicates that we overcome the overfitting issue - which otherwise, without using k-fold CV, would be a main drawback of dealing with same number of features and observation. I have this general question: when using cross validation, how to find out if using it actually helped or not? In more details: 1. How much variance is a good indicator that we don't have overfitting any more? (meaning how much as giving an number such as < 0.2, for example). 2. Maybe the best way to answer this question is measuring which of these 2 methods, performance analysis or error analysis is best? (in more detail: which one of mean squared error, root mean squared error or median absolute deviation or performance variance measurement is best?). Note: maybe my question is somehow repetitive, but I tried my best to read all related questions that were asked in the past, but non of them discuss this problem by considering giving a number. I want to report my result as such (for a problem that I previously asked [here](http://stats.stackexchange.com/questions/218546/overfitting-when-dealing-with-nearly-the-same-number-of-features-and-observation), and when I want to say I overcame overfitting and report a number for indication of this I don't know exactly how much is good).