Wikipedia describes Freedman’s paradox briefly as

a problem in model selection whereby predictor variables with no explanatory power can appear artificially important

with a reference to a 1983 paper by David Freedman.

The term "Freedman's paradox" appears in the title of Model selection bias and Freedman’s paradox by Lukacs et al. from 2010. They write

Freedman (1983) demonstrated that variable selection methods based on testing for significant $F$ statistics commonly include explanatory variables with no relation to the response and spuriously inflate $R^2$ when such irrelevant variables are present. This problem is often referred to as “Freedman’s paradox.” Freedman’s paradox results in spurious effects appearing important.

I haven't been able to find other sources that refers to the problem with variabel selection as Freedman’s paradox, and I am curious about the origin of the terminology.

My question is therefore if anybody knows earlier references than Lukas et al. (2010) that use the term?

Edit: Following @Tim's advice (searching on Google Scholar), I found the technical report Model selection and accounting for model uncertainty in linear regression models by Raftery et al. from 1993, where they write

In the extreme case where there are many candidate predictors but there is no relationship between any of them and the response, standard variable selection procedures often choose some subset of variables that yields a high $R^2$ and a highly significant overall $F$ value. We refer to this unfortunate phenomenon as "Freedman's Paradox" (Freedman, 1983).

This may be the origin of the term, but I welcome any additional early references and other comments about its usage.

  • $\begingroup$ Just to add two simple points: It's good form never to name a paradox after yourself, but someone else doing that is fine. Also, historical attributions can be in error like most other things. Thus, Edward H. Simpson is honoured by the term Simpson's paradox (itself introduced by Colin Blyth) and he did explain it very well in 1951, but the idea has many antecedents, including remarks by Karl Pearson and G.U. Yule. $\endgroup$ – Nick Cox Nov 3 '16 at 13:06

Actually, this is super easy to find via Google scholar. Quick search through Model Selection and Multimodel Inference: A Practical-Theoretic Approach book by Burnham and Anderson (one of the references in Wikipedia article you quote), also shows that they use it. So I guess that if you need any references mentioning it, then Google is a good starting point.

  • $\begingroup$ OK, thanks. I should, of course, have tried Google Scholar! Did that, and found another early reference. $\endgroup$ – NRH Nov 3 '16 at 10:35

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.