# Which model do we select ultimately if we are performing leave one out cross validation

In leave one out cross validation, if I have 10 data points, and I am trying to fit a linear regression model (as an example), then I generate 10 different models, each time using 9 data points and testing the model on the 10th data point.

After that, do I just select the model that gave the lowest error? or do I take an average of the coefficients of the 10 different models for my final model?

• Do you by any chance have the idea that there is actually only one model but you estimate it using 10 different subsamples of the data? Because if you actually have 10 different models (potentially with different variables), how can you average the coefficients? Also, the number of subsamples and the number of models need not coincide. You may have 5 candidate models and 100 subsamples. – Richard Hardy Sep 24 '15 at 18:59
• Yes, there is one model y=a + bx; But (a,b) will have different values for each iteration. In the end, do I just take the average? – Victor Sep 24 '15 at 19:07
• What example are you following? In other words, where did you get this idea? Why do you want to use cross validation to obtain point estimates of the regression coefficients? Using cross validation not for model selection may be more common when you want to look at variation in the point estimates; think about jackknife variance estimator. However, when it comes to point estimates, OLS on the full data sample will give you the minimum-variance linear unbiased estimator (if the model is well specified), so why would you choose an estimator that is still unbiased but has a higher variance? – Richard Hardy Sep 24 '15 at 19:24