# Questions tagged [bayesian]

Bayesian inference is a method of statistical inference that relies on treating the model parameters as random variables and applying Bayes' theorem to deduce subjective probability statements about the parameters or hypotheses, conditional on the observed dataset.

2,715 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
693 views

### Help me understand the Bayesian kernel density estimation (Sibisi and Skilling, 1996)

Sibisi and Skilling (1996, also mentioned in the 1997 paper) define Bayesian kernel density as $$f(x) = \int dx' \,\phi(x')\, K(x, x') \tag{2}$$ Here the kernel $K$ is an assigned smooth ...
352 views

### Is probability fundamentally about reference classes (real or imagined)?

Question: It seems that frequentism and Bayesianism may not really be different as far as the the ultimate basis for what a probability is (relative frequency within a reference class) - it's just ... 14k views

### What does "def" above an equals sign mean?

I am reading this: https://www.cs.ubc.ca/~murphyk/Papers/bayesGauss.pdf and on equation (17), there is a def on top of the equal sign. What does this mean?
175 views

### How to guess the size of a set?

Assume we have a set of unique words and draw a number $n$ of them using simple-random-sampling without replacement independently in each round. We have several rounds and try to guess the set size ...
360 views

### Official name of a common type of Bayesian simulation study

There is a kind of simulation study that is commonly used to validate an implementation of a Bayesian model: For independent replication $i = 1, ..., n$: Draw a set of "true" parameters ...
175 views

### Pope effect on pizza - Regression with presence absence and similarity data as dependent variables

I'm trying to figure out the right way to set up a regression when the dependent variables are presence absence data (of pizzas), and the similarity between the present pizzas. Bear with the story: ...
3k views

### Fourier transform of a Gaussian process

I would like to discuss and ask a question regarding the Fourier transform of a Gaussian process, if it makes sense. For that purpose, let me describe the following situation. Let $z(s)$ be a ...
338 views

### Model checking in bayesian stats considered "virtually illegal" in the 90's (Andrew Gelman's quote)

In this post, Andrew Gelman says: Bayesian inference can make strong claims, and, without the safety valve of model checking, many of these claims will be ridiculous. To put it another way, ...
140 views

### Rationale behind Good–Turing frequency estimation?

Good–Turing frequency estimation is a smoothing estimator for estimating a multinomial distribution. It seems very convoluted. From mathematical statistics point of view, what is the rationale ...
3k views

### Implementing Predictive Posterior Distribution Using Stan

Background I had an example that sought to demonstrate the posterior predictive distribution in the context of a normal measurement model. The data that was used is as follows: ...
3k views

### Mean, median, or mode of skewed posterior?

I'm estimating an ICC from 2 and 3-level hierarchical models using rstanarm. The simplest models are: y ~ (1|group) or ...
1k views

### Density estimation/approximation from MCMC samples

I'm looking to accurately describe the density function of a multivariate posterior probability distribution based on samples from MCMC. As far as I know, in most cases this is done either with a ...
201 views

### Generalization of degrees of freedom for t distribution for coefficients after multiple imputation

Donald Rubin has shown that regression coefficient estimates have fatter tails after multiple imputation and has provided a formula for the degrees of freedom to use as a t-distribution approximation ...
3k views

### Horseshoe priors and random slope/intercept regressions

I'm interested in using the horseshoe prior (or the related hierarchical-shrinkage family of priors) for regression coefficients of a traditional multilevel regression (e.g., random slopes/intercepts)....
1k views

### Predict random effects in a multilevel model with Empirical Bayes

In multilevel models, it is possible to predict (not estimate) the random effects by Empirical Bayes after the model parameters have been estimated. I know how to use the ...
661 views

### Hypergeometric: how do I construct a credibility interval around K (population successes) in R?

I have a problem for which I believe I should use the hypergeometric distribution, but I can't figure out how to do it in R. Say I have a bag of marbles with known number ($N$) of marbles, but the ...
2k views

### PyMC3 implementation of Bayesian MMM: poor posterior inference

Google released a whitepaper on Media Mix Modelling (MMM) in 2017; vanilla MMM (established in the 1960s) uses multivariate regression. It's a decent mechanism to understand which of your marketing ...
11k views

### Singular fit with simplest random structure in lmer (lme4), is a Bayesian approach the only option?

I'm running a mixed model with the lmer function from the lme4 package in R and ran into some issues with singular fits. I get the warning message 'singular fit', ...
108 views

### Trouble replicating simple example of Bayesian inference

On pages 20-21 of John Kruschke's Doing Bayesian Data Analysis book (2nd ed.), there is an introductory illustration of Bayesian inference. We know that balls can have four sizes: 1, 2, 3 and 4, but ...
1k views

### Are Log Predictive Likelihood, Log Predictive Probability, Log Marginal Likelihood and Log Predictive Density same?

I have seen different papers use different terms to express the scoring rules that they used to compare Bayesian models. Some of those terms are, Log Predictive Density (Bayesian Data Analysis - by ...
434 views

### Bayesian inference on mean of statistic from population

Suppose that a collection of time intervals $t_i$ have occurred, for $i=1,...,n$. These should be considered as samples from a population governed by some distribution. During these time intervals, ...
362 views

### How to make Bayesian-style inference for a Poisson process?

I am working on a fleet management software recently. Normally, the arrival of merchant request is a Poisson process. That is to say, on average we have a new merchant request every 10 minutes, but ...
289 views

### Time evolution of a Bayesian posterior

I have a question regarding the time evolution of a quantity related to a Bayesian posterior. Suppose we have binary parameter space $\{ s_1, s_2 \}$ with prior $(p, 1-p)$, The data generating ...
546 views

### Dealing with dependent data in a Bayesian model

Background: Consider a series of dependent data points, $$y_1,y_2,y_3,\cdots,y_N.$$ In cases where the dependence is well described by an exponentially decaying auto-correlation function, it is ...
271 views

### Cox's Theorem: ignorance, objective priors, and the Mind Projection Fallacy

I've been trying to understand Cox's Theorem and the problems surrounding it. There's so much information on this topic that I've become confused as to the exact state of the theorem. I've gathered ...
1k views

### Is my OpenBUGS / WinBUGS model well specified?

I've just started trying to use OpenBUGS for Bayesian analysis of stochastic volatility models. In particular, I'm trying to calculate stochastic covariance, similar to the DC-MSV model specified by ...
187 views

### Question 10.9 from Bayesian Data Analysis, what does accuracy mean here?

I'm doing an independent study in Bayesian Statistics following some chapters from BDA3. When solving the first question from Ch 10 I got stuck. It says: [If] a scalar variable $\theta$ is ...
6k views

### Unscented Kalman filter-negative covariance matrix

I have recently started working on the unscented Kalman filter. I coded the numerically stable version (i.e., square root Kalman filter) and used MATLAB for implementing. In the final update step, ...
164 views

677 views

### Adding a magnitude penalty to a GAM

This is a follow-up to a previous question of mine, explaining the problem in more detail in the hopes of getting more precise advice. Consider the following structured additive regression model or ...
91 views