I've studied statistics now for almost two years and I'm starting to believe I have missed something very fundamental.

I'm doing discriminant analysis where, as I understand it, I can use dummy variables as independent variables. However, one assumption seem to be that the data is drawn from a multivariate normal distribution. Further, the marginal distributions of a multivariate normal distribution are normal (but not necessarily the other way around).

Now, if I use a dichotomous variable (yes/no, etc) as a independent variable, how can the multivariate distribution be normal since a dichotomous variable certainly is not?

  • $\begingroup$ What do you mean by using a dummy variable "as discriminant"? $\endgroup$ – amoeba Feb 18 '15 at 21:47
  • $\begingroup$ The dichotomous variable in your example is not assumed normal. The variables used to estimate the discriminate vector ( a set of independent covariates) are assumed to be multivariate normal. If you are using a dummy to calculate the discriminant vector itself, then multivariate normality is violated and you can use another model (such as a multinominal logit) instead. $\endgroup$ – Zachary Blumenfeld Feb 18 '15 at 22:25
  • $\begingroup$ amoeba: I meant independent variables. Fixed my question. $\endgroup$ – Skrilovach Feb 18 '15 at 23:20
  • $\begingroup$ zach: I'm starting to think I have bigger problems than I initially though... so if I have a function F(x,y)=w1*x+w2*y where x is normally distributed and y dummy variable. F(x,y) can be multivariate normal even though y is not? $\endgroup$ – Skrilovach Feb 18 '15 at 23:25
  • $\begingroup$ You can still use LDA if the data are not normal, but it is not guaranteed to be optimal. See here: Linear Discriminant Analysis and non-normal distributed data. $\endgroup$ – amoeba Feb 18 '15 at 23:39

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.