What advantages does Naive Bayes have over the "not naive" Bayes?

Question

Repeating the question

What advantage does Naive Bayes have over "not naive" Bayes? Considering the fact that the assumption about conditional independence is often violated, why do we make it?

As pretty much any source on the internet states, assumption about conditional independence between features rarely holds. To make things more concrete, consider following example

Define

$$Y := \{\text{boys}\}$$ $$X_1 := \{\text{people that have big muscles}\}$$ $$X_2 := \{\text{people that have short hair}\}$$

Then $P(X_2 \mid Y \cap X_1) = \frac{1}{2}$ but $P(X_2 \mid Y ) = \frac{2}{3}$, implying that $X_1$ and $X_2$ are not conditionally independent.

So repeating the question:

Why do we assume conditional independence when using Bayesian classifier? What advantages does Naive Bayes have over the "not naive" Bayes (i.e algorithm that doesn't assume cond. independence)?

Answer 1

The primary advantage is that the Naive Bayes classifier is a simpler model, and in most cases requires less training data to perform well than a more complex Bayesian network.

This question is worth reading for further discussion of Naive Bayes vs Bayesian networks: https://stackoverflow.com/questions/12298150/what-is-the-difference-between-a-bayesian-network-and-a-naive-bayes-classifier?rq=1