2
$\begingroup$

Given data $(\textbf{X,Y})$, a Gaussian Process $\textbf{F}$ that is normally distributed and weights $\textbf{W}_1$ and $\textbf{b}$ also from a distribution, how come is the following distribution

\begin{align} p(\textbf{Y}|\textbf{X}) = \int p(\textbf{Y}|\textbf{F})p(\textbf{F}|\textbf{W}_1,\textbf{b},\textbf{X})p(\textbf{W}_1)p(\textbf{b}) \label{ref1} \end{align}

a predictive distribution?

Because I thought that a predictive distribution is always, given the data $(\textbf{X,Y})$, the propability of the target label $y^*$ given the new data point $x^*$ data, such as

\begin{align*} p(y^*|x^*,\textbf{X,Y}) = \int p(y^*|x^*,\pmb{\omega}) p(\pmb{\omega}|\textbf{X,Y}) \, d \pmb{\omega} \end{align*}

for some parameters $\pmb{\omega}$.

Currently Im investigating this paper, and in it (section 3.1.) I tripped over the above, for me incomprehensible, predictive distribution.

Anyone has a trick up their sleeve and knows by chance whats going on here?

Cheers

$\endgroup$

1 Answer 1

0
$\begingroup$

It's all about bayesian terminology.

In bayesian statistics the name 'predictive distribution' is used for new data points and for old (training) ones as well. It is an established diagnositic procedure to compare observed y values to their predictive distribution, and in-sample data is used more often than not.

$\endgroup$
4
  • $\begingroup$ Thanks for your answer, am not too familiar with Bayesian terminology yet, cheers! $\endgroup$
    – MJimitater
    Commented Jun 5, 2020 at 19:07
  • 1
    $\begingroup$ Friend @carlo, do you know: why would the author choose to write $p(y^*|x^*,X,Y)$ in one section, specifically emphasizing the use of new values, and in another just simply taking $p(Y|X)$ as predictive distribution? $\endgroup$
    – MJimitater
    Commented Jun 5, 2020 at 19:13
  • 1
    $\begingroup$ I don't know. but I can tell that p(Y|X) is generally referred as posterior predictive distribution in bayesian statistics, where "posterior" is often omitted $\endgroup$
    – carlo
    Commented Jun 5, 2020 at 19:20
  • 1
    $\begingroup$ alrighty, thanks friend $\endgroup$
    – MJimitater
    Commented Jun 5, 2020 at 19:23

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.