9
$\begingroup$

Say I am performing an analysis looking at a particular health measure. I am interested in the difference in that measure between patients and controls and whether or not the difference is different from 0. There have been studies in the past looking at my same research question and health measure, but in different samples of patients.

In my Bayesian analysis I would build up a prior distribution based on the previous studies incorporating the mean difference and standard error.

Please forgive me if this a newbie question as I am newly learning Bayesian stats, but in what ways would the results from my Bayesian analysis differ from the results I would obtain using an inverse variance weighted meta-analysis to combine the mean difference estimates from the prior studies with my current data?

Improve this question
$\endgroup$
3
  • $\begingroup$ What exactly is your "current data"? Do you have collected other (aggregate) study results? Or, do you have individual person data? There exists a couple of papers that discuss Bayesian meta-analysis... $\endgroup$
    – Bernd Weiss
    Commented May 14, 2013 at 7:59
  • $\begingroup$ I have individual person data as my current data so could get all summary/inferential statistics. For the prior studies I don't have individual data but have access to most summary/inferential statistics (like means, SD, SE, t-stats) as well. $\endgroup$
    – derrek
    Commented May 14, 2013 at 18:45
  • $\begingroup$ The difference is large; frequentism and Bayesianism have a different take on the concept of a probability, and this means that any analysis in either framework means something entirely different. $\endgroup$
    – Stijn
    Commented Sep 16, 2013 at 11:24

1 Answer 1

Reset to default
2
$\begingroup$

There are ample references on this question in statistical analysis at large, and in meta-analysis. For instance, have a look here:

Dohoo I, Stryhn H, Sanchez J.Evaluation of underlying risk as a source of heterogeneity in meta-analyses: a simulation study of Bayesian and frequentist implementations of three models. Prev Vet Med. 2007 Sep 14;81(1-3):38-55. Epub 2007 May 2.

Bennett MM, Crowe BJ, Price KL, Stamey JD, Seaman JW Jr.Comparison of Bayesian and frequentist meta-analytical approaches for analyzing time to event data. J Biopharm Stat. 2013;23(1):129-45. doi: 10.1080/10543406.2013.737210. Hong H,

Carlin BP, Shamliyan TA, Wyman JF, Ramakrishnan R, Sainfort F, Kane RL. Comparing Bayesian and frequentist approaches for multiple outcome mixed treatment comparisons. Med Decis Making. 2013 Jul;33(5):702-14. doi: 10.1177/0272989X13481110. Epub 2013 Apr 2.

Biggerstaff BJ, Tweedie RL, Mengersen KL. Passive smoking in the workplace: classical and Bayesian meta-analyses. Int Arch Occup Environ Health. 1994;66(4):269-77.

The following passage from the abstract of Biggerstaff et al is particularly interesting:

...the approximations arising from classical methods appear to be non-conservative and should be used with caution. The Bayesian methods, which account more explicitly for possible inhomogeneity in studies, give slightly lower estimates again of relative risk and wider posterior credible intervals, indicating that inference from the non-Bayesian approaches might be optimistic.

If you are interested in my personal opinion, Bayesian approaches are typically more flexible but more computationally or theoretically complex. In addition, the frequentist approach is based on the tricky concept of hypothesis testing and type I/II errors, whilst the Bayesian approach enables direct probability statements. Finally, Bayesian analysis forces you to explicitly acknowledge your assumptions.

Anyway, I would caution against a meta-analysis in which Bayesian and frequentist approaches are quite conflicting.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.