6
$\begingroup$

I am working on a paper, and have a problem regarding ellipsoid and Trivariate Normal Distribution. Suprisingly I can't find much in literature but I found your in one of your answers:

Because this construction has nothing to do with "confidence" per se, the objective is to establish some convention for describing the shape and relative size of the points. Using 1.96 sort of works (for three variables): it contains about 72% of the probability of the trivariate normal distribution. But as the number of variables increases this method produces ellipses that are far too small. For instance, with 10 variables it will contain only 4.6% of the probability; using 4.28 instead of 1.96 in this case will contain 95% of the probability.

How did you get this number 72%? Or do you have some literature to recommend to me in which I can find this. I would appreciate it very much!

$\endgroup$
3

1 Answer 1

6
$\begingroup$

If $X \sim N_k(\mu,\Sigma)$, then $Q=(X-\mu)'\Sigma^{-1}(X-\mu) \sim \chi^2_k$. Further, the level sets of $Q$ are the ellipsoids you refer to. So the 72% you mention comes from a chi-square distribution (these calcs in R):

> pchisq(1.96^2,df=3)
[1] 0.7209157

As do the other numbers:

> pchisq(1.96^2,df=10)
[1] 0.04579014

> sqrt(qchisq(0.95,df=10))
[1] 4.278672

See http://en.wikipedia.org/wiki/Multivariate_normal_distribution#Prediction_Interval

$\endgroup$
4
  • $\begingroup$ We got 95% confidence ellipsoid for 3 principal components by PCA on the first sample, and wanted to check it with next smaller sample and got the result that 72% of cases are found inside of ellipsoid. Are we right that explanation lies in the fact that ellipsoid contains 72% of the probability of the trivariate normal distribution? $\endgroup$
    – user29976
    Commented Sep 7, 2013 at 19:14
  • $\begingroup$ I'm sorry I didn't quite follow your explanation there. Could you clarify either your explanation of what you did or rephrase your question more precisely into a form that doesn't require an explanation of what you did at all? $\endgroup$
    – Glen_b
    Commented Sep 7, 2013 at 23:48
  • $\begingroup$ Ok. This is the problem. I have three variables (say X,Y and Z) and their measurements from sample (X=[x1,x2,...xn],Y=[y1,y2,...yn],Z=[z1,z2,...zn]). On the basis of those measurements I want to define 95% confidence ellipsoid (in X,Y,Z coordinate space), so that I can infer that 95% of whole population (from which I took my sample) will fit in that ellipsoid. $\endgroup$
    – user29976
    Commented Sep 8, 2013 at 9:14
  • $\begingroup$ Oh, that's a very different problem to the one you posted about; here you're also dealing with the fact that the parameter estimates of $\mu$ and $\Sigma$ are not the same as the population quantities, but are themselves random variables. No hint of this problem is present in the original question. You might like to post a new question discussing the issue you have here. $\endgroup$
    – Glen_b
    Commented Sep 8, 2013 at 9:21

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.