Linked Questions

382 votes
15 answers
153k views

Is normality testing 'essentially useless'?

A former colleague once argued to me as follows: We usually apply normality tests to the results of processes that, under the null, generate random variables that are only asymptotically or ...
shabbychef's user avatar
75 votes
33 answers
7k views

What are the worst (commonly adopted) ideas/principles in statistics?

In my statistical teaching, I encounter some stubborn ideas/principles relating to statistics that have become popularised, yet seem to me to be misleading, or in some cases utterly without merit. I ...
145 votes
9 answers
123k views

How to choose between t-test or non-parametric test e.g. Wilcoxon in small samples

Certain hypotheses can be tested using Student's t-test (maybe using Welch's correction for unequal variances in the two-sample case), or by a non-parametric test like the Wilcoxon paired signed rank ...
Silverfish's user avatar
  • 23.9k
87 votes
10 answers
25k views

Regarding p-values, why 1% and 5%? Why not 6% or 10%?

Regarding p-values, I am wondering why $1$% and $5$% seem to be the gold standard for "statistical significance". Why not other values, like $6$% or $10$%? Is ...
Contango's user avatar
  • 1,499
97 votes
2 answers
13k views

Given the power of computers these days, is there ever a reason to do a chi-squared test rather than Fisher's exact test?

Given that software can do the Fisher's exact test calculation so easily nowadays, is there any circumstance where, theoretically or practically, the chi-squared test is actually preferable to Fisher'...
pmgjones's user avatar
  • 5,851
27 votes
6 answers
72k views

Always Report Robust (White) Standard Errors?

It has been suggested by Angrist and Pischke that Robust (i.e. robust to heteroskedasticity or unequal variances) Standard Errors are reported as a matter of course rather than testing for it. Two ...
Graham Cookson's user avatar
21 votes
4 answers
22k views

How does a Poisson distribution work when modeling continuous data and does it result in information loss?

A co-worker is analyzing some biological data for her dissertation with some nasty Heteroscedasticity (figure below). She's analyzing it with a mixed model but is still having trouble with the ...
N Brouwer's user avatar
  • 2,173
12 votes
6 answers
9k views

How can we ever know the population variance?

In hypothesis testing, a common question is what is the population variance? My question is how can we ever know the population variance? If we knew the entire distribution, we might as well know the ...
BioLogic's user avatar
  • 231
8 votes
2 answers
7k views

How to cross validate stepwise logistic regression?

I have a conceptual problem understanding how to cross validate stepwise logistic regression. Every time the training set is divided it is very likely that different features are chosen based on the ...
Theoden's user avatar
  • 407
10 votes
1 answer
6k views

Clustered standard errors and multi-level models

Stata allows estimating clustered standard errors in models with fixed effects but not in models random effects? Why is this? By clustered standard errors, I mean clustering as done by stata's ...
DanB's user avatar
  • 958
8 votes
3 answers
1k views

What is the best method of reporting multiple tests of equivalence?

I am doing a study which will involve multiple tests of equivalence. Is there a standard table for reporting such results? EDIT with more detail: It is a longitudinal study with 5 time points. Our ...
Peter Flom's user avatar
  • 128k
4 votes
1 answer
5k views

Fisher's exact test vs chi-squared

I've been trying to figure out the correct way to calculate the p-value for my data. I originally created a simulation that randomly selected numbers that were greater than or less than a certain ...
cosmictypist's user avatar
1 vote
1 answer
4k views

Correction of p-values for multiple regression models with multiple comparisons

I was asked to do a correction of p-values for my analyses, but I'm not sure what p-values I am to correct, and presuming I'm using Bonferroni, what is the number that I am dividing the .05 level with....
2gs's user avatar
  • 41