Questions tagged [bayes-factors]
Given some data and two competing models, Bayes factor is the ratio of probabilities to observe these data under one and under another model.
71
questions
0
votes
0answers
6 views
Bayes Factor for each entry in a contingency table?
I have an $m x m$ contingency table. Here is a link to an example contingency table
Entry $x_{ij}$ counts the number of times terms $i$ and $j$ have been mentioned in a corpus of documents.
I am ...
0
votes
0answers
25 views
How to calculate Bayes factor for conditional probability?
I have a data set of 1000 drug-effect pairs. I am trying to identify which drug is most likely given the observed effect.
My original approach was to calculate $P\left(d_j | e_i\right)$ for each ...
1
vote
0answers
12 views
Can I exponentiate the log-Bayes factor to get the Bayes factor?
Simple question here. I'm using Bayesian Confirmatory Factor Analysis and I can get a log-Bayes Factor with the Laplace approximation. However, I'm wondering whether I can just exponentiate this value ...
0
votes
0answers
17 views
R BayesFactor calculation not aligned with result from within-subjects ANOVA
I ran a repeated-measures ANOVA in which the interaction effect was almost significant (F=3.96, p=0.053). However, the Bayes factor comparing the interaction and main effects models favors the main ...
1
vote
0answers
82 views
Expressing one-sided p values of directional hypothesis tests as Bayes factors
Assume we want to test the directional hypothesis that $µ<0$. From a frequentist angle we use a one-tailed $t$-test and imagine we obtain a 1-sided $p$ value of say 0.07, which then would imply ...
5
votes
0answers
749 views
Bayes-Poincaré solution to the Behrens-Fisher problem 2: calculations for Jeffreys’ priors [closed]
In a previous post Bayes-Poincaré solution to k-sample tests for comparison and the Behrens-Fisher problem?, the classical Bayesian and likelihoodist solutions to 2-sample tests for comparison and the ...
0
votes
0answers
31 views
Modeling the Probability of Falling Asleep
Problem
The goal of this exercise is to estimate $p = \text{Pr}(\text{fall asleep})$, the probability of falling asleep imminently, as a mental exercise for those nights when sleep doesn't seem to be ...
4
votes
0answers
904 views
Bayes-Poincaré solution to k-sample tests for comparison and the Behrens-Fisher problem?
I’d like to share and submit for (dis)approval and discussion yet another, simple but original (to the best of my knowledge) Bayesian solution to the classical problem of comparing k samples or groups,...
0
votes
0answers
14 views
Deciphering Prior Concentration for Bayesian Contingency Tables
I'm having some trouble in wrapping my mind about the prior concentration parameter when calculating a Bayes factor for contingency tables.
Specifically, the parameter prior concentration for package ...
1
vote
0answers
36 views
Bayes factors in R for correlated proportions (such as a “Bayesian McNemar's test”)
Is there any way to get Bayes factors in R for correlated proportions (i.e., paired sample)?
For example, the same group of 90 people is measured with one technique, then with another; once there are ...
0
votes
0answers
20 views
Find normalization constant from factorized density
Please consider the following Bayes Network:
We can express density $p(\mathbf{x}_1 | \mathbf{x}_0, \mathbf{y}_1)$ in terms of measurement and motion models by ignoring normalization constants as:
$...
0
votes
0answers
26 views
Likelihood ratio to quantify the similarity between one sample with two other matched samples
I conducted a study with 3 conditions and N subjects. All subjects
performed all conditions once. I would like to know if the first condition
is similar to the second or third condition.
Formally, ...
0
votes
2answers
137 views
Bayes factors and predictive accuracy in model comparison in rstan / brms
Despite reading up on the subject, I can't wrap my head round it, so the question remains on shaky grounds, and responses along the lines of "read chapter x" are very welcome.
What I'm doing is I'm ...
0
votes
0answers
12 views
Bayes Factor for variable importance
Does it make sense to use a Bayes Factor for calculating the effect of a variable on a binary dependent variable?
For example, if I have a binary classifier that classifies Y and a predictor variable ...
11
votes
3answers
1k views
Why are the cut-offs used for Bayes factors and p-values so different?
I am trying to understand Bayes Factor (BF). I believe they are like likelihood ratio of 2 hypotheses. So if BF is 5, it means H1 is 5 times more likely than H0. And value of 3-10 indicates moderate ...
2
votes
1answer
65 views
Bayes Factor A/B Testing
I am just starting to look at Bayesian statistics and so far I am aware that Bayes factor summarizes some form of evidence of an alternative hypothesis against the null one.
As far as I know we can ...
0
votes
0answers
45 views
How to compare approximate Bayes Factors (BIC) with glm.nb? (R stats)
I have a situation where I would like to write up an analysis where the statistical significance is non-significant. I wanted to be able to accept the null hypothesis instead of merely 'failing to ...
0
votes
0answers
75 views
Random effects in a linear model using BayesFactor package: why do bayes factors vary?
I'm using the BayesFactor package with the lmBF and generalTestBF functions to compare different linear models that include participant as a random effect. Below is an example of one of these model ...
2
votes
0answers
26 views
Model selection for this model with one observation
I would like to perform model selection given a range of $k$ models $\mathcal{M}_1, \mathcal{M}_2, ..., \mathcal{M}_k$, each with some prior probability $f(\mathcal{M}_1), \dots, f(\mathcal{M}_k).$
...
1
vote
1answer
227 views
Bayes factors from MCMC samples
I'm working to implement Bayesian model selection among models whose posteriors have already been sampled via MCMC. After reviewing some discussions of Bayes factors, I understand that they are ...
6
votes
2answers
122 views
How are Bayes factors actually Bayesian?
I have been doing some linear model analyses involving Bayes factors lately and I have two probably very basic questions:
1) As far as I understand, a Bayes factor is simply a likelihood ratio, i.e.
...
0
votes
1answer
32 views
How to interpret a statistically signficant finding that becomes unsignificant after bonferroni correlation
I hypothesised I would find a main effect of X which I did (p=0.028), however, upon using the bonferroni correction my alpha dropped to 0.0125, making this result no longer significant.
I found a ...
4
votes
2answers
157 views
Bayes Factor Poisson-Hidden Markov Model
I am following the Hidden Markov Models guide text
for Time Series An Introduction Using R (Walter Zucchini). Chapter 7. Bayesian inference for Poisson-hidden Markov models. Specifically in section 7....
1
vote
1answer
104 views
ABC, compute Bayes factor from posteriors
I am pretty new to ABC stuff so I may be saying dumb things.
My question is: I ran an ABC with two models $M_1$ and $M_2$ and now I have an approximation of the posterior distribution for both model.
...
0
votes
1answer
98 views
Calculating Bayes Factor from Z score, n, and No
I'm completely stuck on how to get this answer from a course below.
I guessed the answer, but I'm lost on how they get to it. I did the following in R
...
2
votes
1answer
67 views
Computation within log space
What is the conversion of the following equation into log space?
$bf2 = 1 + (p * (bf1 - 1))$
Given log.bf1 (log Bayes factor), how do I get to log.bf2 without having to compute bf1, but instead ...
3
votes
1answer
111 views
Diffuse priors Bayes Factor
In textbooks I always read that it is necessary to have a proper prior on the parameter that we want to test with Bayes factor, otherwise we would always posteriori favor the model with less ...
1
vote
0answers
20 views
Uniqueness on bayesian factor model's loading matrix
I'm doing uniqueness on factor loading matrix in a factor model.
$ y = \Lambda f + \epsilon$
where $ f \sim N(0,\Sigma)$ , $\epsilon \sim N(0,\Omega) $ and $\epsilon \perp f$.
It's well known that ...
4
votes
0answers
32 views
How does Lindley compare a Bayes factor and a p-value?
I was reading this paper by Dennis Lindley ("Analysis of a Wine Tasting", J. Wine Econ. 2006). Statistically, the paper is a straightforward analysis of a $10\times 11$ two-way table. To test whether ...
2
votes
1answer
142 views
Bayesian models: Bayesian t-test on effect posterior against 0 as index of effect existence
I am fitting Bayesian models (using R and rstanarm). Beyond estimating the effect of each predictor (and extracting pointwise indices such as median, MAD and 90% CI), I am also interested in having a ...
1
vote
0answers
16 views
How do I prepare data for Rouder & Morey (2012) default prior?
I am going to run an analysis using the default prior outlined by Rouder and Morey (2012); however, I am unclear how exactly to prepare the data.
As a quick overview, I have a continuous DV and a ...
6
votes
1answer
279 views
How would I use the largest expected effect size to determine a prior?
I have a simple experiment in which ~30 people responded to 100 words, half of which were of Type A and half of which were of Type B. I am using a mixed effects linear regression to predict reaction ...
0
votes
0answers
78 views
Calculating Bayes' factor for 2 Gamma distributions
I have 2 model $M_1$ and $M_2$ which both have a gamma distribution and the same priors
$H_0 : \quad x_i \sim M_1 \\ H_a: \quad x_i \sim M_2$
Both $M_1$ and $M_2$ have prior $\sim Ga(7,3000)$ but my ...
1
vote
0answers
33 views
Using Bayes Factor to test Geometric vs Poisson distribution
I have a sample of 200 observations and need to test $H_0: X \sim Geom(p)$ vs. $H_1: X \sim Pois(\lambda)$. Prior distributions are $U[0, 1]$ and $U[0, 20]$. I need to construct a bayes test to ...
1
vote
0answers
358 views
Why is the calculation of Bayes Factors for regression coefficients based on model comparison while delta-R^2 tests are discouraged?
The vast majority of the statistical inference I do is on the basis of multiple regression models (not always OLS, not always single level). Usually the focus is not on the model, but on particular ...
1
vote
0answers
68 views
Bayes Factor for model and variable selection and type I & II error rate
I am trying to implement Bayes Factor for model and variable selection in Bayesian Linear Regression and finding out corresponding type I and type II error. I need your help regarding this. I will be ...
1
vote
1answer
143 views
Choosing a Model Selection Criterion [closed]
I am trying to decide which among for model selection criteria to use for a Bayesian nonparametric model. The candidates are:
The L-criterion, as defined by Laud & Ibrahim (1995);
Bayes factors;
...
2
votes
1answer
217 views
How to account for temporal autocorrelation when computing a Bayes factor between two linear regression models?
I have data of some physiological measure, represented as a vector of 185 measurements taken every 2 seconds. I can model this response in two different ways, and I wish to compare the fit of my two ...
1
vote
0answers
62 views
Bayes Factor for two exponential samples
I'm trying to solve myself such a problem: calculation of Bayes Factor for two groups from exponential distributions.
$$x_1, x_2, \ldots, x_n\sim \exp(\lambda_1)$$
$$y_1, y_2, \ldots, y_m\sim \exp(\...
2
votes
0answers
152 views
Marginal likelihood (or Bayes factor) when true model *not* in the set
The marginal likelihood (or Bayes factor) method to perform model comparison, based on $\Pr(\text{data}|\text{model})$, assumes that the true model is the model set (closed world assumption).
What ...
1
vote
0answers
528 views
Computing DIC and Bayes factor in R
How can I compute the DIC value and Bayesfactor value for a bayesian glm model? (for both models or even just 1 of the models)
I have 2 models I would like to compare.
1. ...
0
votes
1answer
422 views
What is the difference between the posterior density, and the posterior “ordinate” in the context of Bayesian modelling
This is the first time I've come across the term posterior "ordinate" and I'm not sure what it means. I understand what the posterior density of some model parameters given some data refers to, but ...
0
votes
1answer
169 views
Replication study and Bayes factor
I ran an experiment and got a statistically significant result with an effect size of cohen's d=0.36 (N=20). I decided to run a replication study, this time with 60 participants, and got nothing (d=0....
4
votes
2answers
688 views
Reporting Bayes factors
I have calculated a Bayes Factor BF10 for the probability of the data under H1 vs. H0. I get very large numbers (the data are very clear, statistics are barely necessary here), in the order of 10^30.
...
3
votes
1answer
347 views
Bayes Factor and likelihood for two sample from different distributions?
I'd like to calculate Bayes Factor for two-sample t-test $H_0: \mu_1=\mu_2$ (model $M_0$) against $H_1: \mu_1\not=\mu_2$ (model $M_1$)
My data are: $x_1,x_2,\ldots, x_{n_1}\sim N(\mu_1, \sigma)$ ...
0
votes
1answer
454 views
Discrepancy in the results of LMER and BayesFactor (R)
I have a within-subject dataset with 3 two-level factors and 1 numeric
predictor. I was using LMER with a random-intercept model (a full random-effect model yield the same results though throws ...
3
votes
0answers
296 views
Different Bayes Factor values for correlation with the same JZS approach
Trying to get the Bayes Factor for a correlation between two variables in my data, I tried three different functions. All implement the Jeffreys–Zellner–Siow (JZS) prior, but I get quite different ...
1
vote
2answers
2k views
Mixed bayesian ANOVA using BayesFactor package in R
According to a recent paper (open pdf here), one can specify both within- and between-subjects effects in a Bayes factor ANOVA. In the example they give (p. 28), this is specified in the following way:...
2
votes
0answers
199 views
Directional vs Non-Directional Alternative Hypothesis in Bayesian Model Comparison?
I have recently completed a study where I hypothesised a significant difference between two groups. I hypothesised that Group B would be report a significantly lower score on the outcome variable on ...
1
vote
2answers
678 views
Bayesian Model Comparison - Neutral Prior Information
Let's say I estimate two models, $M_{0}$ and $M_{1}$. The posterior odds ratio for for model $M_{0}$ against $M_{1}$ given the data, $y$, is,
$\frac{Pr\left(M_{0}\mid y\right)}{Pr\left(M_{1}\mid y\...
