Linked Questions

4
votes
1answer
1k views

Prediction vs. Explanation and its Effect on Statistical Methods [duplicate]

In layman's terms, what is the difference between predicting and explaining in statistics? I was looking for the differences between AIC and BIC and found this post with an answer stating: My quick ...
15
votes
0answers
835 views

Practical thoughts on explanatory vs predictive modeling [duplicate]

Possible Duplicate: Practical thoughts on explanatory vs. predictive modeling This question has been bugging me for some time, and I was going to write a blog post about it. However, I think it ...
457
votes
20answers
155k views

The Two Cultures: statistics vs. machine learning?

Last year, I read a blog post from Brendan O'Connor entitled "Statistics vs. Machine Learning, fight!" that discussed some of the differences between the two fields. Andrew Gelman responded favorably ...
24
votes
7answers
767 views

Recommendations for non-technical yet deep articles in statistics

The inspiration for this question comes from the late Leo-Breiman's well-known article Statistical Modeling: The Two Cultures (available open access). The author compares what he sees as two disparate ...
11
votes
2answers
1k views

Family-wise error boundary: Does re-using data sets on different studies of independent questions lead to multiple testing problems?

If a team of researchers perform multiple (hypothesis) tests on a given data set, there is a volume of literature asserting that they should use some form of correction for multiple testing (...
3
votes
2answers
2k views

Model Selection in Propensity Score Matching

I am trying to fit a logistic model to create propensity scores. Looking though the literature, there appears to be some disagreement on which covariates to include when designing such a model. Some ...
3
votes
2answers
208 views

A fundamental question about multivariate regression

This is slightly embarrassing, as I've done a fair amount of statistical work, but for years I've heard this niggling voice at the back of my head, and I need to ask someone. I remember when I first ...
1
vote
4answers
332 views

Purpose of leave-one-out cross-validation in descriptive modelling

I refer you to Breiman's paper Statistical Modeling - A Tale of Two Cultures where he illustrated some examples of descriptive modelling. Under section 11.1, 100 runs of regression were performed, ...
3
votes
2answers
106 views

Significance of epidemiological confounders in a generalized linear model

I am identifying risk factors for children snoring among several predictors with generalized linear model. With backward selection, age and sex do not appear to be significant so I removed them from ...
3
votes
0answers
915 views

How to do goodness-of-fit and residual diagnosis for rlm in R?

I am reading What are common statistical sins?, and especially @jebyrnes answer: Failing to test the assumption that error is normally distributed and has constant variance between treatments. ...
3
votes
2answers
232 views

mixed model: is it primarily used for prediction or explanation or both?

Inspired by this post on the difference between explaining and predicting. I want to ask is mixed model primarily used to get better explanation (such as, but not limited to, getting better ...
3
votes
0answers
501 views

Manual vs automated approach for predictive modeling

Many statistics textbooks emphasise a manual modeling design approach, whereby the practictioner performs exploratory analysis by hand to assess several factors including whether there's any ...
3
votes
0answers
156 views

Regression: Causation vs Prediction vs Description

In my experience it seems me that the interpretation about regression, its meaning and its scope, are debatable and great confusion exist about those things. It seems me that confusions are not go ...
1
vote
2answers
46 views

Choosing Interpretable Models model vs choosing black box model and explain it with shap/lime

I analyse a dateset of article. The articles are labeled as popular or not popular and off course each article has features like: article section, article writer and etc. I don't want to predict if a ...
1
vote
0answers
119 views

Variable Selection: Estimation versus Prediction

I have a pretty good grasp of the pros and cons of different methods of variable selection: LASSO and LARS, AIC, stepwise procedures, etc. But my question is: when modeling, should you conduct ...