Questions tagged [exponential-family]

A set of distributions (eg, normal, $\chi^2$, Poisson, etc) that share a specific form. Many of the distributions in the exponential family are standard, workhorse distributions in statistics, w/ convenient statistical properties.

Filter by
Sorted by
Tagged with
1
vote
1answer
32 views

Showing that $E[X^2] = E[Y^2]$ for two RV following Frechet distributions with different location parameters only [closed]

If random variable X follows a Fréchet distribution (https://en.wikipedia.org/wiki/Fr%C3%A9chet_distribution) with shape parameter $\alpha$, scale parameter $s$, and location parameter $m$, that is $X ...
-1
votes
0answers
16 views

Summation of equation [duplicate]

$d_{i}$ are points on a Spherical Surface that are uniformly distributed with PDF $f_{d}(d_{i}) = \frac{3d_{i}^2}{R_{max}^3 - R_{min}^3}$ $|\sum_{i=1}^N exp(j(2\pi(d_{i}-d_{k}))) |^2$ - (1) from this ...
0
votes
0answers
16 views

Laplace distribution as an Exponential Distribution and Minimizitaion of KL Divergence

In the context of Expectation Propagation [Minka's thesis-2001], I would like to approximate an unknown distribution with a Laplace distribution. This can be solved by minimizing KL-Divergence. In ...
0
votes
0answers
12 views

Standard Error of ERGM Coefficients

I am trying to calculate the standard error of ERGM coefficients, which is estimated by MCMC sample. For an ERGM $P(y;\eta) = \exp[\eta^\top g(y) - \psi(\eta)]$, denote $\eta$ as the true parameter, $\...
3
votes
1answer
85 views

Asymptotic normality of MLE

We know under regularity conditions the MLE is asymptotically normal. Usually, it is said that in practice it's hard to check these assumptions. However, I wondered whether we can claim that these ...
0
votes
0answers
37 views

How to prove that von mises distribution belongs to exponential family?

Can anyone help me prove this, I'm not able to simplify the distribution to find the sufficient statistics, log normalizer, etc.
3
votes
1answer
70 views

Finding UMVUE of difference of exponentals

Let $X_1, \ldots, X_n$ be a sample from an exponential distribution with p.d.f. $f(x; \theta) = \theta e^{-\theta x}$ for $x > 0$ where $\theta > 0$ is an unknown parameter. I would like to find ...
0
votes
0answers
31 views

How can write the probability density function of generalized exponential distribution as exponential family?

I want to use GAM method and generalized exponential distribution for response variable. I know GAM method is a generalized GLM method and the distribution of response variable must be in exponential ...
5
votes
1answer
172 views

How do these results show that $T(\mathbf{X})$ is an unbiased estimator of $E_\varphi[T(\mathbf{X})]$ that achieves the Cramer-Rao lower bound?

Let's say that $X_1, \dots, X_n$ has the joint distribution $f_\varphi(\mathbf{x})$ that belongs to the one-parameter exponential family $$f_\varphi(\mathbf{x}) = \exp{\left\{ c(\varphi) T(\mathbf{x}) ...
0
votes
1answer
39 views

The exponential distribution belongs to the exponential family [closed]

I'm new here. I'm trying to proof that the exponential distribution belongs to the exponential family, but I don't know how to do that. Can you help me? Thanks a lot.
0
votes
1answer
61 views

Showing that $f_\varphi(x)$ is a member of the one-parameter exponential family and $\sum_{i = 1}^n - \log(X_i)$ is sufficient for $\varphi$

Let $X_1, \dots, X_n$ denote a random sample from the PDF $$f_{\varphi}(x)= \begin{cases} \varphi x^{\varphi - 1} &\text{if}\, 0 < x < 1, \varphi > 0\\ 0 &\text{otherwise} \end{...
0
votes
0answers
60 views

Why are/aren't these functions members of the exponential family? [duplicate]

I am currently trying to learn about the exponential family of distributions. I am trying to understand this question and this answer from Xi'an. I have the same function: $$f(x; \sigma, \tau)= \begin{...
-3
votes
1answer
163 views

Is Poisson–Lindley an exponential family? If not, why? [closed]

$$\begin{aligned}f_Y(y_i)&=\frac{{\theta_i}^2\left(y_i+\theta_i+2\right)}{\left(1+\theta_i\right)^{y_i+3}}\\ &=\exp\ \log\left[\frac{{\theta_i}^2\left(y_i+\theta_i+2\right)}{\left(1+\theta_i\...
0
votes
0answers
51 views

How is this implied by the properties of the exponential, gamma, and $\chi^2$ distributions?

Let's say we have the random variables $X_1, \dots, X_p$. Furthermore, say that these random variables are a random sample from a PDF of the form $$f_\tau (x) = \begin{cases} \tau x^{\tau-1}, & 0 ...
1
vote
1answer
47 views

What is the MLE of the Continuous Bernoulli distribution?

The continuous Bernoulli is a distribution I recently discovered. What the maximum likelihood estimate of the distribution's parameter? I'm struggling with the normalizing constant.
0
votes
0answers
32 views

Name for $\eta(\theta) \cdot T(x)$ in exponential family distributions

This is a terminology question. Distributions in the exponential family take the form $$ f(x \mid \theta) = h(x)g(\theta) \exp(\eta(\theta) \cdot T(x)) \text{.} $$ ($\eta$ is the natural parameter, ...
0
votes
0answers
29 views

How to prove that the t distribution doesn't belong to the exponential family?

Or in other words, is there anyway prove that the t distribution doesn't belong to the exponential family without going through all that calculation? Since the density has the gamma function in it ...
0
votes
0answers
25 views

Sufficient statistic for a given distribution from exponential form

Given a particular form, i can verify whether it is sufficient statistic or not using $\frac{p_\theta(x_1,x_2...x_n)}{p_\theta(T(x_1,x_2...x_n))}$ is independendent of $\theta$ then i can say $T(\bar ...
0
votes
0answers
19 views

Log normalizer for Multivariate Gaussian (Exponential Family Representation)

I am searching for the log normalizer based on the natural parameters for the multivariate gaussian in the exponential family representation. For the univariate gaussian, it is given by $$ a(\eta) = \...
8
votes
1answer
268 views

Does a sufficient statistic imply the existence of a conjugate prior?

In the comments on this answer, user Scortchi asks: So iff there's a sufficient statistic of constant dimension, there's a conjugate prior? As far as I know this didn't get a complete answer, so I'm ...
0
votes
1answer
39 views

moment generating function of gamma distribution through log-partition function

How to drive the moment generating function of Gamma distribution using log-partition function? Suppose $X\sim\Gamma(\alpha,\beta)$, gamma distribution with parameter $(\alpha, \beta)$. Then $X$ has ...
0
votes
1answer
40 views

Finding UMVUE of function of poisson parameter

I am to estimate $\exp(-\lambda)\lambda^2/2$ from the distribution $Exp(\lambda) \sim \frac{e^{-\lambda}\lambda^x}{x!}$ I used the indicator function $W=\mathbb I_{2}(X_1)$ as an initial unbiased ...
1
vote
1answer
51 views

Gamma family as conjugate prior of Inverse Gaussian with known $\mu$

I want to show that, when $\mu=\mu_0$, then gamma family $\Gamma(a,b)$ is a conjugate prior to inverse Gaussian with density $f(x,\mu,\lambda)=\sqrt{\frac{\lambda}{2\pi x^2}}exp[-\frac{\lambda(x-\mu)^...
4
votes
1answer
51 views

Practical method to do MLE for natural parameters in exponential family

I encountered the following question in my research and I hope this is the correct place to post it. I'm following the notation in this lecture note by Michael I. Jordan. Assume random vector $X$ ...
4
votes
0answers
39 views

Why is the EM algorithm well suited for exponential families?

I've been brushing up on the EM algorithm, and while I feel like I understand the basics, I keep seeing the claim made (e.g. here, here, among several others) that EM works particularly well for ...
0
votes
0answers
19 views

Multivariate canonical exponential family

Consider the canonical d-dimensional exponential family with densities $$p(x)=exp\left(\langle\theta,T(x)\rangle-A(\theta)\right)h(x),\theta\in\Omega$$ with $\Omega\subset\Omega_0=\{\theta:A(\theta)&...
0
votes
0answers
11 views

What are the hyperparameters and base measure in the conjugate prior for the exponential family?

Setup Suppose we have an exponential family model $\{P_{\theta} : \theta \in \Theta\}$. Let the density function of a random variable $X$ and the prior on $\theta$ have following forms: $$ \begin{...
0
votes
1answer
61 views

Jointly complete and sufficient statistics for multivariate normal distribution

Consider the random sample X from the multivariate normal distribution where xi are i.i.d as N(µ,Σ). *Show that the sample mean x̄ and Sample covariance matrix S are jointly complete and sufficient ...
0
votes
1answer
55 views

Canonical form and exponential family

Suppose you have a random variable X, who's distribution depends on $\theta$. If X is a part of the exponential family of distributions, X can be written in a certain form, namely: $$f_\theta(x)=h(x)*...
0
votes
1answer
27 views

How to prove part of exponential family [closed]

We saw that in order to prove a distribution is a part of a exponential family we should be able to write it in this form: f(y;θ)=exp(a(y)b(θ)+c(θ)+d(y) And to prove that: All statistics T are ...
0
votes
1answer
59 views

Does density belong to exponential family?

$$f(x;\theta) = 2x\theta\exp({-x^2})\left( \frac{\exp({-x^2})}{1-\exp({-x^2})}\right)^{\theta\ - 1}\mathbb I_{(\mathbb R_{++})}(x) $$ with $\theta \in \mathbb R_{++} $ does $f(x;\theta)$ belong to ...
2
votes
0answers
22 views

What family of full support probability distributions satisfy that the density of any point in the domain vanishes as the variance goes to infinity?

Let $f(x,\sigma^2)$ be a representative element of a family of PDF's with full support over the reals that is indexed by their variance $\sigma^2$. Under what general conditions of the family of ...
3
votes
1answer
42 views

determine the minimal exponential family form

Suppose we have a random variable $X$ having p.d.f of the form $$f(x|\theta)=\exp\{c(\theta)'T(x)-B(\theta)\}h(x),$$ then we say $X$ is from exponential family. Further, we say that an exponential ...
1
vote
0answers
21 views

Exponential Family distribution with non-open natural parameter space? [duplicate]

Is there any example of canonical exponential family distribution with a natural parameter space, that is not open? An $k$ dimensional canonical exponential family means having a p.d.f (w.r.t base ...
4
votes
1answer
71 views

$\mathbb{E}(X^2+Y^2)=-2\rho$? $(X,Y)$ is from standard bivariate normal distribution and $Cov(X,Y)=\rho$

How to use log partition function to derive $\mathbb{E}(X^2+Y^2)$, where $(X,Y)$ is from standard bivariate normal distribution? By standard bivariate normal I mean $\mu_x=\mu_y=0$ and $\sigma^2_X=\...
3
votes
1answer
75 views

Example of curved exponential family with $T$ being a complete statistic?

Is there any example of curved exponential family with $T$ being a complete statistic? Here $T$ is the sufficient statistic.
1
vote
0answers
59 views

UMP test for exponential family when sufficient statistics $T$ is a vector

Assume we have a random sample $X_1,\dots,X_n$ from a distribution of the form $f(x_i;\theta) = h(x)g(\theta)\exp(\eta(\theta) T(x))$ and we wish to test $H_0: \theta \leq \theta_0, H_1: \theta > \...
3
votes
0answers
31 views

Can the parameter space of a single parameter exponential family in canonical form be a closed interval?

I know that the parameter space has to be convex (that I've proved using Jensen's inequality). Therefore, since it has to be a subset of $\mathbb R$, it follows that it has to be an interval or a ...
7
votes
1answer
176 views

Is $\mathrm{binomial}(n, p)$ family both full and curved for $n$ fixed?

Let $n$ be a fixed positive integer. The binomial$(n, p)$ family is given by $$f(x|p)=\tbinom{n}{x}p^x(1-p)^{n-x}\tag{1}.$$ We may rewrite (1) as $$f(x|p)=\tbinom{n}{x}(1-p)^n\exp\left[x\log\frac{p}{1-...
2
votes
2answers
77 views

Completeness of a statistic - Open ball

I was studying the slides of the course in statistics, but there is a theorem that is not clear for me. This chapter was about finding a complete statistic, and it explains that it can be found with ...
0
votes
0answers
65 views

What is the log-normalizer of the conjugate prior of an exponential family?

Let's say that you have a distribution $F$ in the exponential family with density \begin{align} \newcommand{\mbx}{\mathbf x} \newcommand{\btheta}{\boldsymbol{\theta}} f(\mbx \mid \btheta) &= \exp\...
1
vote
1answer
28 views

Linear relations between statistics in exponential family of distributions

I am reading about point estimation from Theory of Point Estimation by Lehmann and Casella (1999). I couldn't understand the following point mentioned in p.24, under the exponential family of ...
2
votes
0answers
56 views

Mean and variance of the Beta distribution using identities of exponential families

I was studying the part of exponential families from Statistical Inference (George Casella, Roger L. Berger) and they give the following definition of an exponential family: $$ f(x|\pmb{\theta}) = h(x)...
4
votes
2answers
190 views

Distribution of the sufficient statistic in the exponential family?

Suppose $\boldsymbol X$ belongs to the exponential family, $$ f_X\!\left(\,\mathbf{x} ; \boldsymbol \theta\,\right) = h(\mathbf{x}) \, \exp\!\Big(\,\boldsymbol\eta({\boldsymbol \theta}) \cdot \mathbf{...
0
votes
0answers
68 views

how to choose family in CVgam in r?

I'm trying to run a repeated k-fold cross validation of my GAM model, but I can't specify my family in CVgam in R. I want to compare poisson GAM and Negative binomial GAM. How can I solve this ...
1
vote
0answers
24 views

Calculating the conditional expectation of an exponential family [closed]

If we have $X$ with a density depending on the scalar parameter $\theta$, where the density is from of the exponential family: $f(x;\theta) = \exp(\theta x−\phi(\theta))h(x)$. Also we have that $\...
0
votes
0answers
25 views

Examples of functions in generalized linear models

Let $X \in {R}^{n\times p}, Y \in R^{n}$ and $\beta \in R^p$, I am trying to find examples of generalized linear models where the posterior $g_{\beta|y} \propto \exp(-f(y;X,\beta) - \lambda\|\beta\|_2^...
0
votes
0answers
95 views

Normal Conjugate Prior, Known Mean and Unknown Variance?

For Normal distribution, with know mean and unknown variance. When $\tau = 1/\sigma^2$ ~ Gamma(). In such has posterior of $\tau$ has the following distribution: $p(\tau|\alpha, \beta, x) \sim G(\...
2
votes
1answer
65 views

Reparametrization and its effect on sufficient/complete/minimal statistics

Suppose $X_1 \sim Pois(\lambda_1), X_2 \sim Pois(\lambda_2), X_3 \sim Pois(\lambda_1+\lambda_2)$. Separately I can find a sufficient, complete and minimal statistic for each of them. But considering ...
0
votes
0answers
68 views

Can I build deviance residuals from an XGBoost model that learns an exponential family parameter?

I'm taking a course on GLMs after a few years of using machine learning models. The good about GLMs is how the probabilistic model ties in with the estimation and evaluation. So I'm trying to transfer ...

1
2 3 4 5
7