Consider the problem of estimating the number of discoverable extra-terrestrial civilizations (in our galaxy, say), or the related problem of estimating the probability of discovering such a civilization in some given time frame.

The proper way to make such estimations is via Bayesian statistics, where you have prior information about the relevant parameters (number of stars, number of inhabitable planets per star, probability they emit detectable radio signals, etc.) and then revise such probabilities as new data are collected (change in number of inhabitable planets, negative results of radio searches, etc.).

Such prior information is generally presented as the Drake Equation, in which such relevant parameters are multiplied together to get the number of potentially discoverable extra-terrestrial civilizations. It can be extended, given some measure of the search effort, volume of space that can be monitored, etc., to yield the probability of finding such extra-terrestrial life.

I have heard astrobiologists at scientific conferences and numerous popularizers on TV (e.g., Neal deGrasse Tyson) quote enormously large numbers for the potentially discoverable civilizations, and how given the short (~50-year) effort of SETI (Search for Extra-Terrestrial Intelligence) searches, the negative results are "like dipping a tea cup into the ocean, finding no whales and erroneously concluding that there are no whales in the ocean."

But is this true?

I have not seen the proper Bayesian statistical method applied to this problem.

Some questions (astronomical and statistical)

  1. Is there a recent peer-reviewed scientific/statistical paper where the proper Bayesian estimation methods have been applied to this problem? (This 30-year-old paper is the most relevant one I've seen, so far.)
  2. As astronomers find more and more candidate planets, does that mean to a statistician there is an increase the estimated probability we'll find extra-terrestrial life or decrease that probability, given that decades of negative results then imply life is not discovered on a larger number of planets? (Of course one must make some assumptions about coverage, and so on to answer this.)
  3. If, as some SETI workers claim, our negative search results don't significantly lower the prior estimation given by the Drake Equation (see the "whale" discussion, above), then will a statistician conclude that doubling, or even increasing our search effort by one or two orders of magnitude similarly not matter, i.e., not change our estimates significantly?
  4. Given our current estimates for the terms in the Drake Equation and some reasonable extrapolation of search effort (and hence search volume of space and duration of civilization), how long would would a statistician conclude we need to search and at what effort such that the continued negative results would imply the probability of ever finding extra-terrestrial life is negligibly small, say $P \leq 10^{-5}$?
  • $\begingroup$ I remember reading this a few years back. arxiv.org/pdf/1107.3835.pdf $\endgroup$ – Mike Wise Apr 19 '17 at 19:46
  • $\begingroup$ MikeWise: Very helpful citation, but limited to just one (important) factor in the Drake Equation: the probability of the emergence of life of some kind. Given that amidst the hundreds of millions of species that have arisen that only one intelligent (and hence discoverable) species has arisen, I suspect that the chance we find extra-terrestrial life is extraordinarily low. But I'm open to evidence and proper statistical reasoning. $\endgroup$ – David G. Stork Apr 19 '17 at 19:52
  • 1
    $\begingroup$ It isn't clear to me that this question is on topic here. It seems to be more about the astrobiology than about the statistical issues. It might help to make whatever statistical question you have more central. You might also be better asking this elsewhere (eg, the Astronomy SE site). $\endgroup$ – gung - Reinstate Monica Apr 19 '17 at 21:47
  • 1
    $\begingroup$ xeon: Thanks but we statisticians agree upon the supremacy of Bayes over Neyman-Pearson (and incoherencies such as "fuzzy logic"). My question centers on applying the proper Bayesian reasoning to a field where it seems like every month or so astronomers are touting evidence (e.g., new planets) that they claim is increasing the chance we'll find extra-terrestrial intelligence, but somehow (as far as I can tell) don't revise downward such estimates as each year of failure passes. Just trying to keep them honest! $\endgroup$ – David G. Stork Apr 19 '17 at 21:47
  • 1
    $\begingroup$ @xeon: Exactly. Or another analogy: You're searching for a ringing alarm clock in a house consisting of 10 (assumed identical) rooms, each with a cupboard with ten drawers that might hold a ringing alarm clock. You walk into one room and hear no alarm clocks and make your statistical estimations about the presence of such a clock in the entire house. But then someone points out that there were in fact 100 candidate drawers in each room (when you heard no clock). Does your estimate of the probability of a ringing alarm clock anywhere in the house go up or go down (or remain)? $\endgroup$ – David G. Stork Apr 19 '17 at 21:57

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.