I am learning Bayesian statistics for a data mining module. We were given a set of practice questions but no answers and I want to make sure that I am going about Bayes in the right way.

Suppose Manchester United were about to play Arsenal in the Premiership and you assess the probability of Manchester United winning to be 0.7. You also feel that if they did win, there is a probability of 0.9 that your local pub will be packed with fans celebrating their club’s victory. Alternatively, if they loose, you believe that there is still a probability of 0.6 that the pub will be packed with fans albeit for drowning their sorrows. As someone not interested in football, you enjoy a quiet day at work and on the way home, notice a big crowd in the pub. Can you assume that Manchster United won the game? If so, what is the probability of them having won the game?

Attempted solution:

let $p(w)$ denote prob of manchester united winning let $p(f)$ denote prob of pub being full

$p(w|f)=\frac{p(f|w)*p(w)}{p(f)}$ , where $p(f)=p(f|w)*p(w)+p(f|¬w)*p(¬w)$

$p(f)= 0.9*0.7+0.6*0.3=0.81$


So prob of Manchester untied having won is 0.78.

I don't think we can assume they won just because there were people in the pub as there was a 0.6 prob of them drowning their sorrows.

Have I got this right or have I misunderstood Bayesian statistics?

Thanks very much

  • $\begingroup$ Your answer is correct. $\endgroup$ – Cyan Apr 29 '12 at 21:53

You have correctly applied Bayes rule but this is a far cry from understanding Bayesian statistics. Bayesian statistics is a way of doing statistical inference that is different the frequentist approach. Suppose you want to get an interval estimate of the mean of a normal distribution. You first put a prior distribution on the mean then you collect data. Bayes' theorem is used to relate the prior distribution for the mean to the posterior distribution by posterior is proportional to prior times likelihood. The posterior distribution is then used for inference. An interval estimate for the mean that is the Bayesian analog of a 95% confidence interval is a 95% credible interval. You get this by picking points equal distant in each direction from the mean of the posterior distribution and far enough so that the integral from the lower endpoint to the upper endpoint is 0.95. This is what Bayesian statistics is about. It is much more than just Bayes theorem. Bayes theorem is an uncontroversial mathematical result in probability. Bayesian statistics is a paradigm for statistical inference and is somewhat controversial because it assigns probability distributions to unknown parameters.

  • 1
    $\begingroup$ +1 for going above and beyond, @Michael Chernick. I certainly got stuck at this exact point: I could walk through a Bayes Rule application, but actually analyzing a set of data is a bit more complex. Trying to figure out how people were doing it with JAGS/BUGS was a puzzle. The book "Doing Bayesian Data Analysis: A Tutorial with R and BUGS" by John K. Kruschke has really helped me and I can highly recommend it. $\endgroup$ – Wayne May 4 '12 at 12:30
  • $\begingroup$ You may want to look at Speigelhalter et al. They are the British group that developed BUGS. Also George Casella's book on Monte Carlo covers MCMC and Jeff Gill wrote a book on Bayesian Methods for the social sciences that is excellent and also goes pretty deeply into MCMC. Bayesians use MCMC to analyze hierarchical models which can get complicated in their multiple levels of parameterization. $\endgroup$ – Michael R. Chernick May 4 '12 at 16:23
  • $\begingroup$ @MichaelChernick: do you mean Robert and Casella's book?! $\endgroup$ – Xi'an May 6 '12 at 16:25

Both your reasoning and your computations are correct.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.