Questions tagged [hierarchical-bayesian]
Hierarchical Bayesian models specify priors on parameters and hyperpriors on the parameters of the prior distributions
655
questions
0
votes
0
answers
15
views
Why Reversible jump mcmc has only one step increase/ decrease?
I was applying reversible jump MCMC for joint estimation of model order and parameter estimation. I've a conceptual question in my mind. First of all, the algorithm has 3 steps, namely the birth, ...
- 99
2
votes
0
answers
66
views
Is the term “latent effect” in statistics has the same meaning as “latent variable”?
Is the term “latent effect” in statistics has the same meaning as “latent variable”? If not, then what would be its substantive interpretation?
UPDATE:
There is a whole class of models called “Latent ...
- 63
0
votes
0
answers
9
views
Estimating Direct Effect with Conditional Models
I was recently considering the following: Suppose we have an experimental set-up where we have collected observations over thousands of locations (S) before and after treatment (T). Further, we have ...
- 81
3
votes
1
answer
238
views
Is it wrong to use sufficent statistc estimated from the data as a prior in Bayesian data analysis?
First I want to state that I got unexpected feedback from a reviewer in regard to my question and I am simply interested in others' views in this regard (I have already sent in my rebuttal).
Suppose ...
- 135
1
vote
1
answer
67
views
How to test for differences between groups in EEG trial data?
Experiment Setup
Each participant must perform volutary biceps flexions (each flexion is referred to as a trial $t_i$) while staring at a screen. EEG and EMG signals are recorded throughout the ...
- 60
1
vote
0
answers
18
views
Best way of modelling date of month seasonality/cyclical patterns in daily timeseries data, an bayesian approach is proposed!
I have several datasets which exhibits clear seasonality/cyclical patterns w.r.t date of month. The days after the 25th seem to be clearly correlated between months suggesting that in this case ...
- 31
1
vote
0
answers
15
views
Gradient Descent for Multi-Level / Mixed / Hierarchical Regression Model
How would gradient descent work in a multilevel regression setting? This is fairly clear to me in a standard linear regression formulation, but haven't been able to wrap my head around parameter ...
- 11
1
vote
0
answers
27
views
Comparing two randomly loaded dice
Say I have two six-sided dice, A and B, which are loaded in different ways, and I'd like to compare their probability distributions.
So far I've constructed the priors for the probabilities $\vec\pi = ...
- 23
2
votes
0
answers
17
views
In what ways do conjugate priors compose?
A lot of conjugate priors are known for a lot of likelihood distributions (mostly the exponential family). But most Bayesian models in practice don't just consist of one distribution. Usually, you ...
- 180
5
votes
1
answer
49
views
Bayesian (Stan) advantage for estimating small variance components in a multilevel model
Imagine you have some data with one continuous predictor x, a categorical predictor A, and some dependent variable y. You have some amount (enough) data for several subjects S across all conditions. ...
0
votes
1
answer
36
views
Understanding rare definition of the likelihood function and corresponding posterior from research paper
Reading the paper https://storage.googleapis.com/pub-tools-public-publication-data/pdf/b20467a5c27b86c08cceed56fc72ceadb875184a.pdf i came across a rare definition of the likelihood function that in ...
0
votes
0
answers
11
views
How would you compare competing Bayesian hierarchical models that are estimating the same time-series?
Suppose we have two models $\mathcal{M}_1$ and $\mathcal{M}_2$ that attempt to estimate a time-series $\boldsymbol{\theta}$. Let's assume that I actually know the true values for $\boldsymbol{\theta}$....
- 1,615
4
votes
1
answer
190
views
How to interpret the standard deviation of the slope random effect in a multilevel model
How do you interpret the standard deviation of the slope random effect in multilevel models?
Suppose I want to show how Urbanization percentage changed across time in Western and Eastern Europe, so it ...
- 63
0
votes
0
answers
25
views
Hiearchical Beta-Binomial model via rjags: How to draw posterior sample/do inference on posterior exactly?
I have the following code for bugs model which I want to use with rjags:
...
- 11
0
votes
0
answers
15
views
Estimating a model with predictors themselves being random variables
Consider the following scenario: we have iid realizations from $Poi\left(\lambda\right)$, where $\lambda = \alpha + \beta t$. ($t$ is a predictor variable.) So far this is a standard GLM.
However, ...
- 3,243
1
vote
1
answer
42
views
What is the prior corresponding to a weighted sum of pdfs?
Recently, I have read a paper (Bayesian Bridge Regression
, H. Mallick, 2018) which states that since
$$
\frac{\lambda^{1/\alpha}}{2\Gamma(1+1/\alpha)}e^{-\lambda|\beta|^\alpha}=\int_{u>|\beta|^\...
- 273
0
votes
0
answers
28
views
Recommend a book on Bayesian Hierarchical Modeling
I would like to learn about Bayesian Hierarchical Modeling and its applications to time series analysis. I would appreciate a good book / publication / course which will both teach some fundamental ...
1
vote
0
answers
32
views
Loss function definiton for relabelling
Taken from the appendix to the paper (Yongning Wang & Ruey S. Tsay) of this (2019) paper Clustering Multiple Time Series with Structural Breaks. Appendix to be downloaded her Appendix
To fix label ...
1
vote
0
answers
50
views
Latent variables for spatio-temporal Extreme Value in R [closed]
Latent variables models are often used for spatial extremes modeling
see e.g., Davison, Padoan and
Ribatet. A typical application
use block maxima such as annual maxima of temperature, assumed to ...
- 4,393
1
vote
0
answers
30
views
Categorical model divergences/high parameter density near zero in Stan
I'm working on a hierarchical categorical/multinomial logit model in Stan. I thought I'd expand my question to stack exchange to see if anyone has any suggestions on the statistical model, since it's ...
- 111
1
vote
1
answer
61
views
How to calculate Bayesian marginal credible interval?
I have a Bayesian model that I've fit using Stan, and I'm trying to figure out the best way to calculate the correct credible interval that I am interested in.
The model is a hierarchical GLM with a ...
- 292
2
votes
1
answer
29
views
Bayes graph model parameter dependencies problem with prior density
Suppose I have a graph model
with underlying density (denote $f(\theta_1|\theta_0):=f(\theta_1)$)
$$f(\theta|x)\propto \prod_{i=1}^k f(x_i|\theta_{1:i})f(\theta_i|\theta_{1:i-1}). $$
Suppose markov ...
- 41
1
vote
0
answers
51
views
In Bayesian hierarchical models, what is the difference between an Empirical Bayesian approach to parametrising priors vs using flat hyperpriors
Say I have a simple hierarchical model, where:
$y_{g,i} = \beta_g x_{g,i} + e_{g,i}$
where $g$ represents the group, $i$ represents the individual within the group, and $e$ is the error. So the ...
- 51
0
votes
0
answers
21
views
Question regarding the Bayes estimator of a parameter $\theta$ which has a continuous distribution
Let $c > 0$ and
\begin{equation}
L(\theta,a)=\left\{
\begin{array}{@{}ll@{}}
c|\theta-a|, & \text{if}\ \theta < a \\
|\theta-a|, & \text{if}\ \theta \ge a \quad.
\end{array}\...
- 579
0
votes
2
answers
44
views
Bayesian Model(Write out likelihood and prior)
I am working with a dataset regarding transmission rate for a disease spreading among cattle at different farms during a 5-month period.
The goal is to estimate the transmission parameter $\alpha$ ...
- 35
0
votes
0
answers
93
views
Is stationarity of variables neccessary condition for Bayesian VAR?
I am trying to run a BVAR on 5 variables. Four out of five are non-stationary. So shall I do the first difference of the non-stationarity variables or take them in level for running the BVAR?
And what ...
- 1
0
votes
0
answers
18
views
Could laplace method be applied to discrete distribution such as bernoulli, poisson-binomial etc?
I am trying to reproduce the result of the essay:
Variational inferences for partially linear additive models with variable selection(K. Zhao, H. Lian,2014)enter link description here
and encounter a ...
2
votes
0
answers
43
views
Recovering samples from a density estimation with an additional prior on the samples. Used for Gibbs sampling
Abstract Idea:
Given a noisy measured density ($d_j$ at position $p_j$) and a density model, sample from the model parameters under the following stochastic model:
Stochastic Model:
Prior for model ...
- 21
0
votes
1
answer
94
views
What is the correct bayesian formulation for the zero-truncated Poisson lognormal model?
In ecology we use compound distributions to describe species-abundance data. One example is the Poisson Lognormal (PLN) distribution which is a Poisson distribution with rate parameter $\lambda$ that ...
0
votes
0
answers
47
views
How to combine priors for empirical bayes
I am trying to estimate $Z_{i} = P(Y=1 | A=a_{i}, B = b_{i}, C =c_{i})$ using something like empirical Bayes as in http://varianceexplained.org/r/empirical_bayes_baseball/
aggregating a massive amount ...
- 7,790
0
votes
0
answers
75
views
Question about likelihood function in Bayes Rule and marginalization
The following is an instance of Bayes' Rule:
$$P(\alpha, \beta, \gamma, \delta, \epsilon|\mathbf{X}) = \frac{P(\mathbf{X}|\alpha, \beta, \gamma, \delta, \epsilon)P(\alpha, \beta, \gamma, \delta, \...
- 389
0
votes
0
answers
95
views
Estimating the likelihood of a Dirichlet process
I am not sure if what I'm trying to achieve makes sense or is even possible, but I'd like to do MLE on a Dirichlet process mixture model. My reasoning is the following:
If we can write out the ...
- 273
0
votes
0
answers
11
views
Hierachical model causing too much shrinkage?
I use population-wide, 12-year data for examining regional differences in rehabilitation use (zero-inflated, lognormally-distributed outcome variable).
I analysed the outcome variable with 2 models:
<...
- 1,543
1
vote
1
answer
71
views
Parallel with Weighted Least Squared in Bayesian Regression
I have a dataset with a column of ratios $Y = z_1 / z_2$, which will be my depending variable, and a set of columns that explain $Y$.
Here $z_1$ means "imports" and $z_2$ means "exports&...
- 153
0
votes
1
answer
27
views
Bayesian estimation under transformation on the paramater
Consider the classical model Normal-Normal-Inserse-Gamma model:
$$
x=(x_1,...,x_n)|\mu,\sigma^2\sim N(\mu,\sigma^2)\,\,(iid),\,\,\mu\sim N(m_0,\tau),\sigma^2\sim IG(a,b),
$$
where $m_0,\tau,a,b$ are ...
- 53
0
votes
1
answer
86
views
Samples from Conditional Posterior Distribution in Pymc3
Let us consider the following Hierarchical Bayesian model:
$w \sim\ Beta(20, 20)$
$K = 6$
$a = w * (K - 2) + 1$
$b = (1 - w) * (K - 2) + 1$
$theta \sim\ Beta(a, b)$
$y \sim\ Bern(theta)$
The above ...
- 691
0
votes
0
answers
16
views
Is it possible for a hierarchical model to forecast a sub-region with complete lack of data as "borrowing strength"?
I am looking at sales time-series data (weekly from Jan to Dec 2021) which has a natural hierarchical structure by geography. For example, storeA1, storeA2, .... storeA99 located in Neighborhood A, ...
- 1,097
1
vote
1
answer
38
views
Using Pairwise Differences Between Two Conditions as Data (Bayesian)?
Suppose I have measurements for the expression-level of a "gene" from two groups of arbitrary (possibly different) sizes. Maybe one group is a control and the other treated.
$x$ = <4.5, 5....
0
votes
0
answers
76
views
Hyperprior in Gibbs Sampling
Following up from this question, I have managed to derive the following posterior distributions
$$ \lambda_z | \boldsymbol{y}, \Theta^{(-\lambda_z)} \sim Gamma(a + \sum_{i=1}^{n_z} y_{ij}, \quad a + ...
- 1
0
votes
0
answers
117
views
Can we define inverse gamma priors in stan_glmer()?
Although I tried to read the manual, I don't quite see how I can incorporate the following model in stan_glmer().
$Y_{ij}|\mu_j,\sigma_y \sim N(\mu_j,\sigma_y^2)$
$\...
- 3,395
0
votes
1
answer
170
views
Poisson-Gamma Hierarchical Model
I am fairly new to Gibbs Sampling and I am trying to build a Gibbs Sampler for a Poisson-Gamma hierarchical model.
In this model, there are $m$ restaurants in a city, with $n_z$ number of observations ...
- 1
4
votes
3
answers
487
views
inverse gamma (0.001,0.001) prior on the variance in the Bayesian hierarchical model
This 8 schools data is from Gelman 2006 paper: http://www.stat.columbia.edu/~gelman/research/published/taumain.pdf. In Figure 1 (c), the prior density of inverse gamma (0.001,0.001) was overlain on ...
- 615
0
votes
0
answers
40
views
marginal likelihood in relevance vector machines RVM
I need to do a fit of 1d response versus 1d input, both real quantities.
I wanted to implement Linear Regression, but because I wanted uncertainty in the resulting fit-params, I studied about Bayesian ...
- 101
0
votes
0
answers
290
views
Choosing priors for the parameters of Gamma distribution
Suppose that $X_1, X_2, \cdots, X_n$ is a sample drawn from a Gamma distribution with parameter $\alpha$ and $\beta$. Then, the likelihood function can be written as follows:
\begin{equation}
L(\...
- 131
1
vote
2
answers
142
views
Why are prior distributions sometimes conditional probabilities?
I came across the following Bayesian equation in textbook of evolutionary biology:
$f(t, r, \theta|X) \propto f(X|t, r, \theta)f(t|\theta)f(r|t,\theta)f(\theta)$
$f(X|t, r, \theta)$ is the likelihood ...
- 389
1
vote
0
answers
69
views
Modeling "Pay as Much as You Want" with a Bayesian Model
I have data of sales of a certain product which is sold "Pay as Much as You Want".
The daily data is in the form of number of sales per day and the total revenue per day:
Day
Sales
Revenue
...
- 337
0
votes
0
answers
33
views
Extension of normal-gamma to gaussian process prior
I am trying to solve a problem where the solution involves both the mean and the variance of a multivariate normal distribution, modelled through a Gaussian Process prior.
The standard Gaussian ...
- 11
0
votes
1
answer
96
views
Samples from Marginal Posterior Distribution in Pymc3
Let us consider the following Hierarchical Bayesian model:
$mu \sim\ Beta(1, 1)$
$k \sim\ Exponential(1)$
$a = k*mu$
$b = (1-mu) * k$
$theta \sim\ Beta(a, b)$
$y \sim\ Bern(theta)$
The above example ...
- 691
0
votes
1
answer
40
views
How can I find the acceptance probability for a joint Metropolis-Hastings proposal?
Suppose that I want to generate a proposal $(x^*,y^*,z^*)$ with the following:
$$z^*\sim p(z|\alpha,\beta)$$
$$x^*\sim p(x|z^*,\boldsymbol{\gamma}_x)$$
$$y^*\sim p(y|z^*,\boldsymbol{\gamma}_y),$$
...
- 5
0
votes
1
answer
41
views
What means that the model is "singular"?
My question might be rather basic, theoretical.
I am running spatial and spatial-temporal bayesian models in INLA. I have areal data and a continuous response variable with spatial and temporal ...
- 33