276
$\begingroup$

What is your favorite statistical quote?

This is community wiki, so please one quote per answer.

$\endgroup$
1
  • 10
    $\begingroup$ Should this question really be "famous quotes about statistics"? $\endgroup$
    – naught101
    Nov 3, 2012 at 4:29

152 Answers 152

11
$\begingroup$

"New methods always look better than old ones. Neural nets are better than logistic regression, support vector machines are better than neural nets, etc." - Brad Efron

$\endgroup$
3
  • 4
    $\begingroup$ shame they often only look better... :-( $\endgroup$ Aug 17, 2010 at 12:05
  • $\begingroup$ Yeah, the first part of that quote is saying a different thing to the second part ("look" vs. "are"). $\endgroup$
    – naught101
    Mar 28, 2012 at 9:38
  • $\begingroup$ They also bring in new clients, which then has to be converted to the good old methods ... $\endgroup$ Mar 22, 2018 at 8:24
10
$\begingroup$

'Figures fool when fools figure'.

Henry Oliver Lancaster

$\endgroup$
10
$\begingroup$

A statistical analysis, properly conducted, is a delicate dissection of uncertainties, a surgery of suppositions.

-- M.J. Moroney

$\endgroup$
2
  • $\begingroup$ Thanks. Had the opportunity to work with a great statistician for a while and was always amazed by how much information he could get out of the least amount of data by asking very pointed questions. This quotation so reminds me of hm $\endgroup$ Jul 29, 2010 at 3:30
  • $\begingroup$ Nice quote, though I can't help imagine how it would sound being spoken by Chris Eubank... $\endgroup$
    – onestop
    Nov 8, 2010 at 8:57
10
$\begingroup$

efficiency = statistical efficiency x usage.

-- John Tukey

$\endgroup$
10
$\begingroup$

A bit obscure this one, but a great quote about subjective probability:

... There is no way, however, in which the individual can avoid the burden of responsibility for his own evaluations. The key cannot be found that will unlock the enchanted garden wherein, among the fairy-rings and the shrubs of magic wands, beneath the trees laden with monads and noumena, blossom forth the flowers of probabilitas realis. With these fabulous blooms safely in our button-holes we would be spared the necessity of forming opinions, and the heavy loads we bear upon our necks would be rendered superflous once and for all.

Bruno de Finetti, Theory of Probability, Vol 2

$\endgroup$
10
$\begingroup$

A man who ‘rejects’ a hypothesis provisionally, as a matter of habitual practice, when the significance is at the 1% level or higher, will certainly be mistaken in not more than 1% of such decisions. For when the hypothesis is correct he will be mistaken in just 1% of these cases, and when it is incorrect he will never be mistaken in rejection. [...] However, the calculation is absurdly academic, for in fact no scientific worker has a fixed level of significance at which from year to year, and in all circumstances, he rejects hypotheses; he rather gives his mind to each particular case in the light of his evidence and his ideas.

-- Sir Ronald A. Fisher, from Statistical Methods and Scientific Inference (1956)

Another quote as a commentary: "This passage clearly is intended as a criticism of Neyman and Pearson, although again their names are not mentioned. However, these authors never recommended a fixed level of significance that would be used in all cases. [...] Thus Fisher rather incongruously appears to be attacking his own past position rather than that of Neyman and Pearson" (from Fisher, Neyman, and the Creation of Classical Statistics by Erich Lehmann, section 4.5).

$\endgroup$
10
$\begingroup$

"A frequentist is a person whose long-run ambition is to be wrong 5% of the time."

Unknown.

$\endgroup$
2
  • $\begingroup$ Why does this frequentist exclusively look at null hypotheses? :) $\endgroup$
    – Cliff AB
    Jun 1, 2020 at 15:05
  • $\begingroup$ "A frequentist is a person whose..." that's an old fiction. There are no frequentists and Bayesians as if this is a characteristic of a person like a nationality or religion. Maybe you could still compare it to something like jobs, like somebody who paints is a painter and somebody who works with electricity is an electrician. However, I would like somebody who does statistics to be a statistician and not a Bayesian or frequentist. $\endgroup$ Jun 1, 2020 at 16:12
10
$\begingroup$

Bayesians address the question everyone is interested in by using assumptions no-one believes, while frequentists use impeccable logic to deal with an issue of no interest to anyone

Louis Lyons

$\endgroup$
9
$\begingroup$

These days the statistician is often asked such questions as "Are you a Bayesian?" "Are you a frequentist?" "Are you a data analyst?" "Are you a designer of experiments?". I will argue that the appropriate answer to ALL of these questions can be (and preferably should be) "yes", and that we can see why this is so if we consider the scientific context for what statisticians do.

--G.E.P. Box

$\endgroup$
9
$\begingroup$

9 out of ten dentists think the 10th dentist is an idiot.

  • No idea who said it.
$\endgroup$
2
  • 2
    $\begingroup$ Similar to 80% of car drivers think they're "above average". $\endgroup$ May 28, 2011 at 13:42
  • $\begingroup$ "9 out of 10 persons like chocolate. 1 is lying." $\endgroup$ Mar 19, 2020 at 17:24
9
$\begingroup$

The business of the statistician is to catalyze the scientific learning process.

George Box

$\endgroup$
9
$\begingroup$

To understand God's Thoughts we must study statistics for these are the measure of His purpose.

--Florence Nightingale

$\endgroup$
1
  • $\begingroup$ Only problem is that god itself either eludes statistical reasoning or is statistically very unlikely to exist. $\endgroup$
    – Momo
    May 26, 2013 at 8:53
9
$\begingroup$

[Statistics are] the only tools by which an opening can be cut through the formidable thicket of difficulties that bars the path of those who pursue the science of man.

-- Sir Francis Galton

$\endgroup$
9
$\begingroup$

The roll of the dice will never abolish chance

Written in 1897 by Stéphane Mallarmé (1842-1898) , a famous French poet - In French :

Un coup de dés jamais n'abolira le hasard

$\endgroup$
0
9
$\begingroup$

The probability is like the stick used by the blind man to feel his way. If he could see, he would not need the cane, just as if we knew which horse runs faster, then we would not need probability theory.

Stanislaw Lem

$\endgroup$
9
$\begingroup$

Context: An F-test is often a poor way to justify pooling, because F-test is not robust against non-normality.

"To make a preliminary test on variances is rather like putting to sea in a rowing boat to find out whether conditions are sufficiently calm for an ocean liner to leave port." (G.E.P. Box, "Non-normality and tests on variances",

Source: Biometrika, 40 (1953), pp 318-335, quote on page 333; via from Moore & McCabe.

(props to Tim Hesterberg: https://stat.ethz.ch/pipermail/r-help/2008-February/154856.html)

$\endgroup$
9
$\begingroup$

People think that if you collect enormous amounts of data you are bound to get the right answer. You are not bound to get the right answer unless you are enormously smart. Bradley Efron

$\endgroup$
9
$\begingroup$

1

Uncertainty is a personal matter; it is not the uncertainty but your uncertainty. (Dennis Lindley)

Reference: Dennis Victor Lindley (2006), Understanding Uncertainty, Wiley-Interscience, p. 1.

$\endgroup$
5
  • $\begingroup$ The picture is of John Nelder, not Dennis Lindley. $\endgroup$
    – Nick Cox
    Jan 28, 2016 at 19:46
  • $\begingroup$ @NickCox You're right! Here's the origianl Lindley: statisticsviews.com/details/feature/5060491/… $\endgroup$
    – Ho1
    Jan 29, 2016 at 14:27
  • $\begingroup$ To play on the usual joke about cosmologists, theologians, economists, etc., Lindley appears not to have acted on his own maxim. He was certain that almost other statisticians were wrong. $\endgroup$
    – Nick Cox
    Jan 29, 2016 at 14:33
  • $\begingroup$ @NickCox So, is certainty also personal? :-) $\endgroup$
    – Ho1
    Jan 29, 2016 at 16:23
  • $\begingroup$ I'm certain of it. $\endgroup$
    – Nick Cox
    Jan 29, 2016 at 16:29
8
$\begingroup$

"He who loves practice without theory is like the sailor who boards ship without a rudder and compass and never knows where he may be cast." - Leonardo da Vinci, 1452-1519

Found here.

$\endgroup$
1
  • $\begingroup$ -1 not really stats specific... $\endgroup$
    – naught101
    Nov 3, 2012 at 10:39
8
$\begingroup$

A quote from Karl Pearson:

The unity of all science consists alone in its method, not in its material

I think of statistics as, essentially, the methodology of science, so that's how I interpret this quote.

$\endgroup$
8
$\begingroup$

"As far as the laws of mathematics refer to reality, they are not certain, as far as they are certain, they do not refer to reality." albert einstein

$\endgroup$
7
$\begingroup$

You may be too vague to be wrong and that's really bad cause that's just obscuring the issue.

Bruce Sterling

$\endgroup$
2
  • 2
    $\begingroup$ Also a favorite topic of Michael Shermer of Skeptic magazine. "That's not even wrong." $\endgroup$
    – rolando2
    May 28, 2011 at 13:21
  • $\begingroup$ "Not even wrong" is often mentioned as a standard put-down of the acerbic (but very smart) physicist Wolfgang Pauli. $\endgroup$
    – Nick Cox
    Jan 16, 2018 at 18:07
7
$\begingroup$

"I cannot conceal the fact here that in the [application of probability theory], I foresee many things happening which can cause one to be badly mistaken if he does not proceed cautiously.",

Bernoulli (1713) (via ET Jaynes)

"A statistician is someone who knows what to assume to be Gaussian"

Dikran Marsupial (2009) (not famous yet ;o).

$\endgroup$
2
  • $\begingroup$ Do we vote for the first one or the second one :) ? $\endgroup$ Aug 13, 2010 at 16:35
  • $\begingroup$ first one, I'm not famous... yet ;o) BTW, the second one is intended as a complement, just in case there was any doubt. $\endgroup$ Aug 17, 2010 at 11:50
7
$\begingroup$

Everybody knows that probability and statistics are the same thing, and statistics is nothing but correlation. Now the correlation is just the cosine of an angle, thus all is trivial.

-- Emil Artin, according to Kai Lai Chung in Elementary probability theory (right, Artin might not been known primarily as a statistician)

$\endgroup$
7
$\begingroup$

The researcher armed with a confidence interval, but deprived of the false respectability of statistical significance, must work harder to convince himself and others of the importance of his findings. This can only be good.

Michael Oakes, Statistical inference: A commentary for the social and behavioural sciences (NY: Wiley, 1986)

$\endgroup$
7
$\begingroup$

"The statistician cannot evade the responsibility for understanding the processes he applies or recommends." -- Sir Ronald A. Fisher in The Design of Experiments (1935)

$\endgroup$
3
  • $\begingroup$ True, but the data scientist can. Understanding? We don't need no stinking understanding. $\endgroup$ Jan 28, 2016 at 21:28
  • $\begingroup$ Without understanding, no real progress can be made. $\endgroup$ Jan 29, 2016 at 5:49
  • 1
    $\begingroup$ Duplicate of an answer above. $\endgroup$
    – user46481
    Jul 7, 2016 at 4:33
6
$\begingroup$

Statistics are the triumph of the quantitative method, and the quantitative method is the victory of sterility and death.

~ Hillaire Belloc in The Silence of the Sea

$\endgroup$
1
  • $\begingroup$ Hillaire Belloc? Nice work on digging that up. $\endgroup$
    – Shane
    Jul 27, 2010 at 16:43
6
$\begingroup$

We statisticians, as a police of science (a label some dislike but I am proud of...), have the fundamental duty of helping others to engage in statistical thinking as a necessary step of scientific inquiry and evidence-based policy formulation. In order to truly fulfill this task, we must constantly firm up and deepen our own foundation, and resist the temptation of competing for “methods and results” without pondering deeply whether we are helping others or actually harming them by effectively encouraging more false discoveries or misguided policies. Otherwise, we indeed can lose our identity, no matter how much we are desired or feared now.

Xiao-Li Meng

$\endgroup$
1
  • $\begingroup$ nice quote - and you can see the inherent "pessimism" in stats folk, for she speaks of "false discoveries" and not of "missed discoveries" (which are just as important). $\endgroup$ Apr 3, 2011 at 1:24
6
$\begingroup$

“Statistics is much like a streetlight. Not very enlightening, but nice for supporting you”

Storm P

$\endgroup$
1
  • 4
    $\begingroup$ Wasn't this based on an older variation? $\endgroup$
    – Tal Galili
    May 27, 2011 at 15:26
6
$\begingroup$

We may regard the present state of the universe as the effect of its past and the cause of its future. An intellect which at a certain moment would know all forces that set nature in motion, and all positions of all items of which nature is composed, if this intellect were also vast enough to submit these data to analysis, it would embrace in a single formula the movements of the greatest bodies of the universe and those of the tiniest atom; for such an intellect nothing would be uncertain and the future just like the past would be present before its eyes.

Pierre-Simon de Laplace. Also known as Laplace's demon

$\endgroup$
1

Not the answer you're looking for? Browse other questions tagged or ask your own question.