2
$\begingroup$

I have a multivariate Gaussian parameterised by a mean vector $\mu$ and a precision matrix $\Sigma$. Now, I want to set the Gaussian along a given dimension $i$ to a point mass i.e. I set the corresponding diagonal entry i.e. $\Sigma_{ii}$ to infinity (zero variance) and also set all the entries in the ith row and column to 0.

Now, what I would like to know is how should the mean vector be adjusted to account for this? Also, if someone would be kind enough to describe an intuitive reason of how changing the covariance parameters affects the mean vector, that would be great.

$\endgroup$
4
  • 1
    $\begingroup$ Setting a diagonal element to infinity makes no sense: perhaps you meant zero? Regardless, there is no basis for adjusting the mean: the mean, as a parameter separate from the variance matrix, remains whatever it was regardless of what changes you make to the matrix. $\endgroup$
    – whuber
    Feb 25, 2014 at 19:50
  • $\begingroup$ The reason I said infinity is because I am parameterising it with the precision matrix, so $\Sigma$ is the precision matrix and infinity is sort of the placeholder for undefined precision. I saw some software from Microsoft that is doing some update on mean, which seemed strange to me as well as the mean and covariance are independent parameters of the distribution. I will look more into this and update this thread tomorrow. $\endgroup$
    – Luca
    Feb 25, 2014 at 22:22
  • 1
    $\begingroup$ Thank you: I even thought you might be using a precision matrix but still overlooked your reference to it! I suspect your MS source may be updating a conditional mean. $\endgroup$
    – whuber
    Feb 25, 2014 at 22:25
  • $\begingroup$ I am pretty sure I might have overlooked something. The code is quite complex, so it is probable that I have overlooked something. I will have access to it tomorrow and will make sure that I update the thread. $\endgroup$
    – Luca
    Feb 25, 2014 at 23:05

1 Answer 1

2
$\begingroup$

Sorry to have taken some time to come back. The answer is, as I suspected, was my own failure in understanding the code. The distribution was parameterised using precision and the $\textit{product}$ of mean and precision. I think this is so that certain calculations were easy. So, when the variance was being set to $0$ along a dimension, it was this product of mean and precision that was getting adjusted.

If anyone is interested, look up the Infer.NET code by MS research but it makes sense to me now. Sorry for raising a false alarm.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.