1
$\begingroup$

Given an arbitrary dataset, how would one decide whether to use GDA (Generalized Discriminant Analysis) or Logistic Regression? Is the only way to choose via trying both and selecting the one with better performance or is there some way of determining which model to use pre-training?

$\endgroup$
1
  • 1
    $\begingroup$ Logistic regression makes fewer assumptions than discriminant analysis. Unlike multivariate normality assumptions in discriminant analysis, logistic regression makes no distributional assumptions. $\endgroup$ Nov 4, 2021 at 13:26

1 Answer 1

1
$\begingroup$

Which analysis is more appropriate depends on the goal of the analysis, not only on the dataset. So what is your goal (you forgot to tell us)? In most cases with a binary response variable an estimate of risk (probability) will be of interest, so then logistic regression is indicated. See Why isn't Logistic Regression called Logistic Classification? why this is different from classification.

Even if the ultimate use is classification, first obtaining probability estimates is useful, since then an ultimate decision can be takes which uses loss functions which can vary from subject to subject, with unit characteristics. See for instance this answer by @Frank Harrell.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.