15
$\begingroup$

Very simply put: Are there any differences in Bayesian and Frequentist approaches to Exploratory Data Analysis?

I know of no inherent biases in EDA methods as a histogram is a histogram, a scatterplot is a scatterplot, etc., nor have I found examples of differences in how EDA is taught or presented (ignoring a particularly theoretical paper by A. Gelman). Finally, I looked at CRAN, the arbiter of all things applied: I haven't found packages tailored to a Bayesian approach. However, I thought CV might have a few people who could shed a light on this.

Why should there be differences?

For starters:

  1. When identifying appropriate prior distributions, shouldn't one investigate this visually?
  2. When summarizing data and suggesting whether to use a frequentist or Bayesian model, shouldn't the EDA suggest which direction to go?
  3. The two approaches have very clear differences on how to handle mixture models. Identifying that a sample likely comes from a mixture of populations is challenging and directly related to the methodology used to estimate the mixture parameters.
  4. Both approaches incorporate stochastic models and the selection of model is driven by understanding the data. More complex data or more complex models necessitates more time in EDA. With such distinctions between stochastic models or generating processes, there are differences in EDA activities, so shouldn't there be distinctions arising from different stochastic approaches?

Note 1: I'm not concerned with the philosophies of either "camp" - I only want to address any gaps in my EDA toolkit and methods.

$\endgroup$

2 Answers 2

19
$\begingroup$

In my mind, Bayes vs frequentist is about formal inference, and exploratory data analysis is neither.

Certainly, when it comes to model assessment/goodness-of-fit and sensitivity analysis, in which I'd classify your points (1), (3), and (4), there will be differences in how one would proceed, but that's because the nature of the differences between the analysis and computational methods rather than about philosophy.

Regarding your (2), I don't generally see the results of the EDA as pointing you towards the Bayesian or frquentist approach, but rather I'd think it was the goal of the study that mattered most.

For me personally, the EDA (plus deep introspection) would point me towards a model, and if I could find a natural frequentist approach that answered the scientific question reasonably well, I'd go with that, but if by the nature of the situation, no frequentist method would work well, and if there were a reasonable prior, I'd use Bayes.

$\endgroup$
12
  • $\begingroup$ (+1) Very well said -- especially, "EDA (plus deep introspection) would point me towards a model" $\endgroup$
    – suncoolsu
    Sep 3, 2011 at 0:36
  • $\begingroup$ +1 as well. EDA really isn't about choosing a perspective, its about understanding your data to make more informed decisions. $\endgroup$
    – Fomite
    Sep 3, 2011 at 6:44
  • $\begingroup$ +1 For a good answer. Unfortunately, I think that the original question was misunderstood. I wasn't asking about using EDA to decide between Bayesian or frequentist models. I'll need to review how I worded it if it seems that several people have the same misunderstanding. $\endgroup$
    – Iterator
    Sep 3, 2011 at 13:01
  • 3
    $\begingroup$ I think my definition of "exploratory data analysis" is more narrow than yours. In my view, all good data analysis involves exploration. What distinguishes "exploratory data analysis" is the lack of a model or any effort towards formal inference. $\endgroup$
    – Karl
    Sep 3, 2011 at 16:18
  • 1
    $\begingroup$ See Rubin (1984), and all of Gelman's work on posterior predictive checks. Exploratory data analysis can be tied much more closely to model building and checking than is typically done. These papers, in particular Rubin (1984), shows how frequentist ideas are relevant to Bayesian inference. $\endgroup$
    – Tristan
    Sep 8, 2011 at 3:33
0
$\begingroup$

I thinks that, EDA helps you to build a model, make some assumptions and (if required) update the model and its assumptions. I select a pragmatics approach to use for model fitting and assessment.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.