# Questions tagged [naive-bayes]

A naive Bayes classifier is a simple probabilistic classifier based on applying Bayes' theorem with strong independence assumptions. A more descriptive term for the underlying probability model would be "independent feature model".

586 questions
Filter by
Sorted by
Tagged with
15 views

### Naive Bayes fits multiple hyperplanes in the case of multiclass classification problems?

Naive Bayes differentiates feature distributions given target labels, and intuitively, it fits a hyperplane to the given data set. But I do not fully understand whether Naive Bayes fits multiple ...
56 views

### Understanding the application of MLE in Naive Bayes

I was looking at the Naive Bayes classifier models (Binomial, Multinomial and Gaussian) and trying to understand the theory behind them a bit better, but am unsure if I understand the MLE approach ...
• 173
21 views

### Population stability index and Text Data Length

I'm training a language detection model using: a training set, classified between English and not English sentences or small paragraps, where the length of the sentences can vary a score set that is ...
1 vote
32 views

### Assuming Independence in Naive Bayes

If features of the Naive Bayes are not independent then what are the consequences of the results?
• 19
36 views

### Understanding rare definition of the likelihood function and corresponding posterior from research paper

Reading the paper https://storage.googleapis.com/pub-tools-public-publication-data/pdf/b20467a5c27b86c08cceed56fc72ceadb875184a.pdf i came across a rare definition of the likelihood function that in ...
1 vote
33 views

### interpreting confusion matrix results

I have a dataset on unemployed individuals enrolled in a job training program where I am trying to predict whether 6 months post-enrolment they 1) gain employment, 2) stay unemployed, or 3) drop out ...
21 views

### If I engineer a new feature such that feature C = feature A/feature B, must I drop features A and B from a Gaussian Naive Bayes model?

As the question asks, is it bad data science not to drop the dividend and divisor features when creating a new feature that is their quotient when working with a Naive Bayes model? My understanding of ...
• 137
13 views

### Is it possible for the gains line to fall below the naive rule in a lift chart?

I created a naive Bayes model and generated this lift chart . Is it possible that my model could underperform the naiveBayes rule?
78 views

### AUC - Logistic Regression versus LDA, and Naive Bayes

everyone! I am a newbie on machine learning, and I am now interested on classification modeling. I used logistic regression, linear discriminant analysis (LDA), and naive Bayes on my notebook DataCamp ...
13 views

• 439
26 views

### How to use K-fold classifier for comparison of different models

I am learning machine learning and went through a term K-fold cross validation. I also took notes from this site to enhance my understanding. As per the tutorial if it is 3 fold cross validation and ...
• 133
243 views

### How many divergent transitions are too many?

I am running a Bayesian linear mixed effects analysis. Four chains for 3000 iterations. I end up with four divergent transitions. Is this too many or can I proceed? How do I know if it's too many? I'...
• 1,691
15 views

### Naive Bayes for data generation

NB is a classification method which according to Bishop's book is categorized in probabilistic generative methods. As far as I understood you can learn a join distribution from input-output pairs and ...
1 vote
15 views

### Base rate calculation for customer conversion

Question: What is the base rate of conversion for mobile versus desktop sites? Total no of customers: 590381 Out of 590381, the Total no of customers that were converted: 701 These customers used ...
• 11
924 views

### Intuition for why LDA is a special case of naive Bayes

The naive Bayes classifier assumes the regressors to be mutually independent, while linear discriminant analysis (LDA) allows them to be correlated. James et al. "An Introduction to Statistical ...
• 57.8k
293 views

### Why is naive Bayes overconfident?

In the fourth edition of "Artificial Intelligence: a modern approach" by Russel and Norvig, they write in section 12.6, regarding the Naive Bayes Model for text classification, the following:...
• 171
1k views

### How can Naive Bayes overfit the data?

I know that Laplace smoothing results in a high bias of Naive Bayes. If the value of the smoothing parameter (alpha) is large, then the probability distribution will be uniform for all the features. ...
225 views

### Parameters in Naive Bayes

This is from https://scikit-learn.org/stable/modules/naive_bayes.html In the last line it says and we can use Maximum A Posteriori (MAP) estimation to estimate $P(y)$ and $P(x_i|y)$; the former is ...
• 21
1 vote
1k views

### Product of two normal distributions (for Bayes Rule) is not product of normal output variables?

When we apply Bayes' rule in machine learning, we want to compute the posterior probability $P(y|X)$ by multiplying two probability distributions (the observed class-conditional likelihood $P(X|y)$ ...
207 views

### Logic of Sklearn Bernoulli Naive Bayes Classifier when the the predictors are not even binary?

I know the mathematics behind the Naive Baye's Bernoulli Classifier Algorithm and it is used to calculate the probabilistic results. As we know the Bernoulli Naive Bayes Classifier uses binary ...
75 views

### Binary Classification with OpenNLP

I'm trying to apply binary classification with OpenNLP. I could already successfully classify movies by different genres. The data sample has the form: ...
92 views

### Does it make sense to use Gaussian Naive Bayes for a single feature?

I understand that 'Naive' Bayes refers to the approach where all the features are assumed to be independent. But I want to evaluate the performance of each feature individually before I combine all of ...
• 183
45 views

### How to re-write with Bayes' Rule as a function?

I'm a little bit stuck. Say I have a P(A | B ^ C). How could I re-write this as a function with the terms P(B|A ^ C), P(B|C) and P(C|B) and can anyone explain how this was done?
• 1
245 views

### Naive Bayes - having trouble coming up with a case where Laplace smoothing changes the prediction

I'm thinking through the logic of Naive Bayes and encountered a brain teaser. I know that adding smoothing (alpha) to Naive Bayes can help to increase the accuracy of the model, which implies that it ...
• 123
1 vote
484 views

### How to choose prior in Laplace Smoothing Naive Bayes?

Please check the image for reference How to choose the prior probability of each feature . Should we use the same prior for every feature or different features use different prior. for example ...
173 views

### How should I handle Laplace smoothing in Naive Bayes in this example?

I have a toy dataset on animals, with 4 features and 2 possible classes (mammals vs non-mammals). I have summarized the dataset ...
• 111
73 views

### On the denominator of Bayes and Naive Bayes

There are many question on the topic but I think the comparison below is harder to find. Let us assume that all variables in this example are binary for the sake of simplicity. The typical academic ...
• 541
515 views

### Why does Multinomial Naive Bayes work well on discrete features?

I understand Multinomial Naive Bayes is a specific instance of Naive Bayes when the data distribution is assumed to be multinomial. In the sklearn documentation for Multinomial Naive Bayes, it is ...
• 183