# Questions tagged [prior]

In Bayesian statistics a prior distribution formalizes information or knowledge (often subjective), available before a sample is seen, in the form of a probability distribution. A distribution with large spread is used when little is known about the parameter(s), while a more narrow prior distribution represents a greater degree of information.

680 questions
Filter by
Sorted by
Tagged with
63 views

### Accounting for uncertain information (few observations) in a prior (empirial Bayes)

I did not really know how to choose an adequate title for this question, so please feel free to change it. I have a weird case wherein frequentist and Bayesian philosophies come together. I am ...
17 views

### What is the point of using an uninformative prior distribution? [duplicate]

If I am completely unknowing as to the true value of $\theta$ in some parameter space $\Theta$, why would I use a flat prior distribution when all the information about $\theta$ will be in my sample? ...
42 views

### Can an improper prior distribution be informative?

I have just worked through an example where, with an improper prior, the bayesian estimator equals the maximum likelihood estimator, leading me to believe that improper priors are uninformative. But ...
8 views

### Finding prior conjugate for reparametrized model

Let $X_i$ be iid Bernoulli$(\pi)$ for $i=1,...,n$. My task is to find the prior conjugate for $\theta$, where $\theta$ is the natural parameter of the sampling model. The sampling model can be ...
757 views

### What are the best ways to generate Bayesian prior estimates using beliefs of non-statisticians?

I work with a lot of qualitative researchers and designers. Many of whom interact with users and develop strong, often accurate intuitions about how the data should look. I frequently try to quantify ...
18 views

### Sampling a proposed value with a limited range target when running MCMC [duplicate]

I want to do an MCMC algorithm and need to sample a proposed value from a proposed distribution. In the Metropolis algorithm, people usually use a normal distribution as proposal. But if the prior ...
13 views

### Linear regression - Bayesian Predictive distribution

I am trying to answer a question about linear regression but i am stuck: $y=w \cdot x + \epsilon, \epsilon \sim N(0,\alpha)$ i am also given a prior: $w\sim N(0,\beta)$ from which i was able to ...
37 views

### What prior would lead to $\ell_\infty$ regularization of model weights?

Gaussian prior on weights of a GLM lead to Ridge / $\ell_2$ squared regularization. Laplace prior leads to $\ell_1$ regularization Question What prior would lead to $\ell_\infty$ regularization ?
43 views

### Random-walk prior with ridge-like regularizarion?

I am working with a model that contains a large number of coefficients, arranged in an ordered vector $\beta_1, \dots, \, \beta_N$. I have some prior knowledge that could be used to improve the ...
7 views

### Sampling prior covariance matrices - nested sampling

I am trying to fit a multivariate Gaussian with a non-diagonal covariance matrix $\Sigma$ using nested sampling. Usually, in other Bayesian analyses, we would use a Inverse Wishart or LKJ prior on ...
22 views

### Bayesian inference with simple models and many data points: impact of priors and the number of data points

The setting. Let us assume I would like to perform Bayesian inference for a low-dimensional model on a large dataset, i.e., there are many more data points than there are parameters to identify. Let ...
28 views

### How to select variables when using shrinkage priors?

I am fitting a linear regression model using shrinkage priors (Horseshoe and Laplace/LASSO). This shrinks many of the variables close to zero, but I would like to select the variables. Can I use the ...
24 views

### Why is Half-Cauchy, Half-Student-t as prior for variance parameters better than a normal distribution?

Gelman often refers to using half-cauchy or half-student-t distributions for variance parameters. Why is it better than using a vague normal distribution such as N(0,10)? Can somebody explain me the ...
25 views

### State of the art (2019) of spike and slab priors?

Spike and slab priors for variable selection https://www.tandfonline.com/doi/abs/10.1080/01621459.1993.10476353 were initially proposed using a combination of normals prior and a mass at zero. After ...
80 views

### Why in Hamiltonian MCMC do we multiply the posterior distribution by the likelihood?

So maybe I am misunderstanding what the author is staying, but I am reading Chapter 14 of Kruschke's Doing Bayesian Analysis. I am reading about the software Stan and how it uses the Hamiltonian MCMC ...
31 views

### Setting a prior for zero-one-inflated beta bayesian regression

This is my first attempt with Bayesian statistics. I need to figure out if I have enough information to set more informative priors for a zero-one-inflated beta regression in ...
26 views

### What do these equations on Bayesian regression (MAP) from Chapter 3.3 in PRML by Bishop mean?

This was taken from Ch 3.3 on Bayesian Linear Regression from Pattern Recognition in Machine Learning by Bishop. Apparently the posterior can be described by eq 3.49. Eq 3.48 represents the prior ...
31 views

### Explanation of Equation 5.3 from Gaussian Processes for Machine Learning

I am currently reading through C. E. Rasmussen & C. K. I. Williams' Gaussian Processes for Machine Learning and was going through chapter 5. I could not exactly understand the derivation of ...
24 views

### Find posterior distribution given prior distribution

Problem Be $X_1,...,X_n$ a random sample of $X$ ~ $Geometric(\theta)$, i.e., $f(x|\theta)=\theta(1-\theta)^x \forall x = 0,1,2,...$ Assuming a prior distribution for $\theta$ find the posterior ...
11 views

### Deriving full conditional of ordered probit model (Bayes)

I have a question regarding the following exercise: I am able to compute the complete (full) data likelihood function, the full conditionals of $y^{*}_i$ and $\beta$. However, I do not know how to ...
447 views

### Shrinkage priors

I am building a Bayesian model where I to put shrinkage priors such as spike and slab, horseshoe prior, etc on some parameters for feature selection, but I am not able to decide which one is the best. ...
38 views

### Bayesian Linear Regression, trouble with posterior. Variance equal identity

I am trying to solve the following problem. If $y | \beta \sim N(X \beta, I_n)$ and $\beta \sim N(0, g^{-1}(X^t X)^{-1})$ for $g>0$. Find $\pi(\beta|y)$ and show that $E(\beta|y)$ is a function ...
8 views

### What is the prior of $\ell_{2,1}$ loss in Multi-Task learning?

We all know Laplacian prior is the prior for Lasso, as the MAP of a Bayesian setting. Multi-task lasso is a generalized lasso for multi-task problems, which encourages group-wise sparisty. However, ...
17 views

### analogy on Tenenbaum's phd thesis (on prior, likelihood, posterior)

This is from the book: Machine Learning from a Probabilistic Perspective page 69 and 70. There is a very interesting analogy/explanation on how to visualise Prior, Likelihood and Posterior ...
42 views

### Deriving posterior mean with horseshoe prior

I want to decompose a matrix $S \in \mathbb{R}^{D \times D}$ as below $$S=vv^T$$ where $v_i\mid\lambda_i,\tau_i \sim N(0,\lambda^2_i\rho^2_i)$, $\lambda_i \sim Cauchy^+(0,1)$ i.e $v$ has horseshoe ...
25 views

### Reproducing a didactic example of Lindley (1993)

Lindley (1993) discusses the following mixed discrete and continuous prior for the tea tasting lady experiment, where $\pi$ is probability of a correct classification: $p(\pi=0.5) = 0.8$ (discrete ...
48 views

### Questions about the principles of Bayesian analysis + R [closed]

Let's say I have a data of flywing lengths which is identically distributed (normal). (data: https://seattlecentral.edu/qelp/sets/057/s057.txt). I want to estimate the mean (theta). I have to choose ...
42 views

### Borrowing observations for prior probability in Bayesian Inference

For the purposes of Bayesian Inference, is it assumed that the historical observations used for the prior probability values must be from the exact entity for which you are looking to calculate the ...
11 views

### Quantifying a reduction in prior uncertainty over several experiments

I am interested in how to quantify reductions in uncertainty about the size of an experimental effect over a series of studies which, for hypothetical reasons, preclude the merging of data. I would ...
28 views

856 views

### Bayes-Poincaré solution to k-sample tests for comparison and the Behrens-Fisher problem?

I’d like to share and submit for (dis)approval and discussion yet another, simple but original (to the best of my knowledge) Bayesian solution to the classical problem of comparing k samples or groups,...