The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [hierarchical-bayesian]

Hierarchical Bayesian models specify priors on parameters and hyperpriors on the parameters of the prior distributions

Filter by
Sorted by
Tagged with
4
votes
2answers
2k views

Normalizing constant irrelevant in Bayes theorem?

I've been reviewing Bayesian literature in an attempt to utilize Bayesian inference for hypothesis testing when I have very well established priors, but there's one thing I cannot get my head around: ...
8
votes
4answers
5k views

Covariance matrix proposal distribution

In a MCMC implementation of hierarchical models, with normal random effects and a Wishart prior for their covariance matrix, Gibbs sampling is typically used. However, if we change the distribution ...
8
votes
1answer
378 views

Is rstan or my grid approximation incorrect: deciding between conflicting quantile estimates in Bayesian inference

I have a model to achieve Bayesian estimates the population size $N$ and probability of detection $\theta$ in a binomial distribution solely based on the observed number of observed objects $y$: $$ p(...
8
votes
1answer
637 views

Hierarchical Bayesian modeling of incidence rates

Kevin Murphy's book discusses a classical Hierarchical Bayesian problem (originally discussed in Johnson and Albert, 1999, p24): Suppose that we are trying to ...
4
votes
1answer
526 views

Relation between Bayesian analysis and Bayesian hierarchical analysis?

I have been studying a Bayesian hierarchical model. In that model all I am dealing is with the estimation of parameters. In Bayesian analysis, loosely speaking, we update our prior knowledge (in light ...
16
votes
2answers
2k views

Bayesian estimation of $N$ of a binomial distribution

This question is a technical follow-up of this question. I have trouble understanding and replicating the model presented in Raftery (1988): Inference for the binomial $N$ parameter: a hierarchical ...
10
votes
3answers
4k views

Multinomial-Dirichlet model with hyperprior distribution on the concentration parameters

I will try to describe the problem at hand as general as possible. I am modeling observations as a categorical distribution with a parameter probability vector theta. Then, I assume the parameter ...
4
votes
2answers
1k views

Bayes-factor for testing a null-hypothesis?

I heard somewhere, that I can directly test (or gather support for) a null-hypothesis using the Bayes-Factor. In my specific experiment, I hypothesize that an experimental manipulation does not have ...
5
votes
1answer
834 views

Crossvalidation in hierarchical bayesian models (HBMs)

I am trying to find a way to cross-validate Hierarchical Bayesian Models used for predicting and modelling abundance in Species Distribution Models. For this purpose, I have tried posterior predictive ...
10
votes
2answers
824 views

What is a good analogy to illustrate the strengths of Hierarchical Bayesian Models?

I'm relatively new to bayesian statistics and have been using JAGS recently to build hierarchical bayesian models on different datasets. While I'm very satisfied of the results (compared to standard ...
8
votes
1answer
2k views

Hyperprior distributions for the parameters (scale matrix and degrees of freedom) of a wishart prior to an inverse covariance matrix

I'm estimating several inverse covariance matrices of a set of measurements across different subpopulations using an wishart prior in jags/rjags/R. Instead of specifying a scale matrix and degrees ...
8
votes
1answer
690 views

What level to use when comparing subjects in a hierarchical Bayesian analysis?

Say that I have an experiment where I test the reaction time of a number of subjects where each subject makes many reaction time trials. In a Bayesian framework the reaction times ($y$) could be ...
6
votes
0answers
2k views

Hyper-prior for negative binomial in hierarchical model using JAGS/BUGS

Below I'm using a negative binomial because it is more flexible than a simple poisson model. The data are counts $y$ of events for 16 individuals $x$. There are 14 counts (i.e. counting periods) for ...
4
votes
1answer
234 views

Bayes Rule with Model Comparison

In Doing Bayesian Data Analysis 2ed, by Kruschke, in chapter 10, we get two equations (10.1, 10.2) for which no hint as to how they are obtained is given... How does one get the second equality in ...
4
votes
2answers
332 views

What are some statistical tests for exchangeability of a data set?

The representation theorem of de Finetti is seen by some as motivation for the use of Bayesian and/or hierarchical modeling. In some settings, it may be plausible to assume measurements are ...
4
votes
1answer
148 views

Bayesian regression with independent variable drawn from distribution

I'm trying to set up a bayesian regression of the form $y_i \sim f(\beta_0 + \beta_1 x_i)$ but rather than $x_i$ fixed, they themselves are drawn from a distribution of (known) mean $x_i \sim g(\...
4
votes
2answers
2k views

Use of Bayesian hierarchical model

What is the purpose of Bayesian hierarchical model? When should I use such models? I've found many questions here and references on the web but they are all too technical. My doubts are about the ...
3
votes
1answer
1k views

Gibbs sampling with mixed prior using a Metropolis-Hastings step

My questions are about a sampling procedure for fitting a Bayesian hierarchical model where one of the priors is a mixture distribution of discrete and continuous parts. The model is not my own but I ...
2
votes
1answer
143 views

Is there any reason to prefer a bayesian model with few variables?

I have two alternative hierachical bayesian models that were designed to the describe the same process (from a high-level point-of-view). Both model provides comparable (but not identical) inferences ...
2
votes
1answer
297 views

Risk and posterior expectation Bayesian Statistics

Consider $x\sim B(n,\theta)$ with $n$ known a)If $\pi(\theta)\sim Beta(\sqrt{n}/2,\sqrt{n}/2)$ give the associated posterior distribution and posterior expectation $\delta^\pi(x)$ b)Show ...
3
votes
0answers
1k views

Is this correct hierarchical Bernoulli model?

I have a question about correctness of a model that I used for a fairly simple experiment. I'm not sure if it should go to stackoverflow or crossvalidated, because I feel like my question is both ...
2
votes
0answers
103 views

If all components of a hierarchical model have not converged, can we say that any parameters have truly converged?

I'm working with a hierarchical regression model of the following form similar to that presented in Peter D. Hoff's book, A First Course in Bayesian Statistical Methods: $\boldsymbol{Y}_j \sim \text{...
2
votes
2answers
418 views

Confusion about Cross-Validation for Hierarchical Bayesian Regression Models

I had two questions regarding model selection for a Hierarchical Bayesian (HB) Regression Model and the purpose of Cross-Validation. 1). I understand cross-validation as one way to perform model ...
1
vote
2answers
244 views

Bayesian Modeling: Yes, No and Maybe Responses

Respondents replied in the following way: Yes: they will be attending No: they won't be attending Maybe: they attach a percentage certainty as an estimate that they'll be attending. E.g. 40% sure ...
1
vote
1answer
319 views

What is the correct form of Metropolis Hasting step in scaled Inverse Wishart prior for covariance matrix?

I was going through the paper of O'Malley and Zaslavsky (2008) for the scaled inverse Wishart priors for a covariance matrix, in order to write an R-code for hierarchical Bayesian estimation of mixed ...
2
votes
1answer
668 views

How to find the Likelihood Function in a Bayesian Model given some Data

How should I find the likelihood function of a Bayesian Model? For example, if I'm given a coin, I can use the Bernoulli Distribution as the likelihood function (because I know in advance that the ...
2
votes
0answers
70 views

How to model a multiplicative effect of a parameter

I am having difficulty in fitting a model on data. Basically, I have data about the evaluation of phenotypic property (i.e. hard) of 65 palm trees by 5 judges. As an evaluation scheme, each judge ...
1
vote
1answer
321 views

Why semi/nonparametric models?

Increasing the flexibility of models makes it prone to overfitting. On the other hand, it looks to me that, if the space function classes $\mathcal{F}$ is too big, it is hard to prove bounds on ...
1
vote
0answers
33 views

How to model whether discrete count data are statistically-enriched in certain regions for spatial data?

I feel like there is a straightforward way to model this dataset, but I'm a bit stuck. Let me give you a metaphor for the data first: Let's say that we are looking at a strip of land of fixed ...
1
vote
1answer
1k views

Jeffrey's prior for variance

I'm dealing with hierarchical model where $Y_i$ are from normal distribution. About variance the formulation is the following: Similarly, the data contain substantial information about the measurement ...