When JW Tukey retired he wrote an article called Sunset Salvo in which he, among other things, enumerates some Numerical Antihubrisines. These are different rules of thumb for how many observations you need to for eg. make your confidence intervals so-and-so narrow. I struggle with understanding the following antihubrisine:
Measuring a $\sigma^2$ to one significant figure (taking this as, for instance, being reasonably sure for any $u > 0$, whether $2.5u$ or $3.5u$ is correct) [...] In the optimistic, Gaussian case, [requires] about 300 degrees of freedom. In more realistic cases, up to two or three times as many degrees of freedom.
I have many questions about this, maybe because I don't 100% understand the parenthesis in the quote:
- How does he define the number of "successfully estimated" significant figures? Something to do with standard errors?
- If we can't measure it to one significant figure in most cases, what can we use $\sigma^2$ for at all? Can we do something useful with, say, half a significant figure? Is that a thing?
- What exactly is the calculation in this optimistic Gaussian case to arrive at $\approx 300$?
- Are we more confident about $\sigma$ than $\sigma^2$?
