4
$\begingroup$

Let $x\sim N(\mu,\sigma^2)$ and $\mu\sim N(\xi, \tau^2)$.

To test whether $\mu<0$ or $\mu>0$, in Bayesian inference it's usual to take the perspective of hypothesis testing as model selection. In that perspective,

$M_1:\mu<0$ and $M_2:\mu>0$ .

There are at least two ways to compute $P(M_{True}=M_1|x)$. The easy one seems to use the fact that $P(M_{True}=M_1|x)=P(\mu<0|x)=\Phi(-\xi(x)/w)$, since it's known that $\mu|x\sim N(\xi(x),w^2)$ .

(to save space-time I won't write $\xi(x)$ or $w$ formula)

The second way to calculate the $P(M_{True}=M_1|x)=\frac{\int l_k(\theta)\pi_k(\theta) d\theta \ \ P(M=k)}{\sum_j\int l_j(\theta)\pi_j(\theta) d\theta \ P(M=j)}$.

I'm trying to do by the second way. However, I get $P(M_{True}=M_1|x)=1-\Phi(-\xi(x)/w)=\Phi(\xi(x)/w)$

This is based on the book Bayesian Essentials, page 40.

Any help would be appreciated.

Edit: for the second way, we define $$\pi_1(\mu)=\frac{\exp\{-(\mu-\xi)^2/(2\tau^2\}}{(2\pi \tau^2)^{1/2}\Phi(-\xi/\tau)}\mathbb{I}_{\mu<0}$$ $$\pi_2(\mu)=\frac{\exp\{-(\mu-\xi)^2/(2\tau^2\}}{(2\pi \tau^2)^{1/2}\Phi(\xi/\tau)}\mathbb{I}_{\mu>0}$$

$\endgroup$
5
  • $\begingroup$ For what its worth, I teach students to do the "easy one" as it seems very arbitrary to me to turn the question into a hypothesis testing question. $\endgroup$
    – jaradniemi
    Commented Jan 23, 2017 at 20:46
  • $\begingroup$ For the second approach, I don't think you have defined enough. I'm assuming your priors for $\mu$ under the two models are the truncated versions of the prior for $\mu$ that you defined. I'm also assuming that the prior model probability is the integral of the defined prior with respect to that model. $\endgroup$
    – jaradniemi
    Commented Jan 23, 2017 at 20:49
  • $\begingroup$ Uh? The equation (2.7) on page 40 does give $\Phi(-\xi(x)/w)$ as the answer. $\endgroup$
    – Xi'an
    Commented Jan 24, 2017 at 7:34
  • $\begingroup$ @jaradniemi I've added a few details. May you help me? Thanks $\endgroup$ Commented Jan 24, 2017 at 8:54
  • $\begingroup$ @Xi'an I'm not sure I understand you. I don't manage to get the solution of the text by 2nd way... $\endgroup$ Commented Jan 24, 2017 at 8:56

1 Answer 1

2
$\begingroup$

You are correct in setting the restricted priors \begin{align*} \pi_1(\mu) &= \frac{\exp\{-(\mu-\xi)^2/(2\tau^2\}}{(2\pi \tau^2)^{1/2}\Phi(-\xi/\tau)}\mathbb{I}_{\mu<0}\\ \pi_2(\mu) &= \frac{\exp\{-(\mu-\xi)^2/(2\tau^2\}}{(2\pi \tau^2)^{1/2}\Phi(\xi/\tau)}\mathbb{I}_{\mu>0} \end{align*} Next step is identifying the prior weights \begin{align*} \mathbb{P}(\mathfrak{M}=M_1)&=\mathbb{P}(\mu<0)=\Phi(-\xi/\tau)\\ \mathbb{P}(\mathfrak{M}=M_2)&=\mathbb{P}(\mu>0)=\Phi(\xi/\tau) \end{align*} which leads to the posterior probability \begin{align*} \mathbb{P}(\mathfrak{M}=M_1|x)&\propto \int_{-\infty}^0 \varphi(\{x-\mu\}/\sigma) \pi_1(\mu)\,\text{d}\mu\times\mathbb{P}(\mathfrak{M}=M_1)=\int_{-\infty}^0 \varphi(\{x-\mu\}/\sigma) \pi(\mu)\,\text{d}\mu\\ \mathbb{P}(\mathfrak{M}=M_2|x)&\propto \int_0^\infty \varphi(\{x-\mu\}/\sigma) \pi_2(\mu)\,\text{d}\mu\times\mathbb{P}(\mathfrak{M}=M_2)=\int_0^\infty \varphi(\{x-\mu\}/\sigma) \pi(\mu)\,\text{d}\mu \end{align*} or [denoting $\mathfrak{m}(\cdot)$ for the marginal density of $X$] \begin{align*} \mathbb{P}(\mathfrak{M}=M_1|x)&\propto \mathfrak{m}(x) \int_{-\infty}^0 \pi(\mu|x)\,\text{d}\mu=\mathfrak{m}(x) \Phi(-\xi(x)/w)\\ \mathbb{P}(\mathfrak{M}=M_2|x)&\propto \mathfrak{m}(x)\int_0^\infty \pi(\mu|x)\,\text{d}\mu=\mathfrak{m}(x) \Phi(\xi(x)/w) \end{align*} which leads again to $$\mathbb{P}(\mathfrak{M}=M_1|x)=\Phi(-\xi(x)/w)$$

$\endgroup$
2
  • 1
    $\begingroup$ Many thanks. I thought the prior weights could be anything as long as $P(M=M_1)=1-P(M=M_2)$... That's one of the reasons why I didn't get exactly the same. The other being a typo in my calculations. Now I get it. Thanks ;) $\endgroup$ Commented Jan 24, 2017 at 10:19
  • 1
    $\begingroup$ @Anoldmaninthesea. Well, in a sense, you are free to model those weights as you wish when you run hypothesis testing and model comparison. However, if you start from a prior over the whole space as stated in the question, this prior induces the said weights. $\endgroup$
    – Xi'an
    Commented Jan 25, 2017 at 14:18

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.