# Questions tagged [naive-bayes]

A naive Bayes classifier is a simple probabilistic classifier based on applying Bayes' theorem with strong independence assumptions. A more descriptive term for the underlying probability model would be "independent feature model".

166 questions
1k views

### How can I get feature importance for Gaussian Naive Bayes classifier?

I have a dataset consisting of 4 classes and around 200 features. I have implemented a Gaussian Naive Bayes classifier. I want now calculate the importance of each feature for each pair of classes ...
602 views

### Computation of log-likelihood in semi-supervised naive bayes

I have the following 2 questions about log-likelihood computation in semi-supervised Naive Bayes. I have read on several documents online that, in every EM iteration of the semi-supervised Naive ...
1k views

### Combining multiple classifiers

I am trying to do a binary classification of text articles into {relevant, non-relevant}. The text articles have following features: [[article text, ...
3k views

### Is the Naive Bayes family of classifiers linear?

There are a lot of places where you'll see the proof that Naive Bayes classifiers are linear, like this and this. But they always assume a special case of the family of Naive Bayes classifiers which ...
801 views

22 views

### Naive Bayes: Understanding the Entropy equation

I am trying to understand the entropy equation: -p1*log2(p1) - p2*log2(p2) - pn*log2(pn) Specifically why do we multiply each log by the probability? In the ...
139 views

### Does smoothing make any sense for Bernoulli Naive Bayes?

I'm trying to understand how the hyperparameters for the Bernoulli Naive Bayes in sklearn work for doing Randomized Search CV. If I use smoothing, and set ...
76 views

### use test data set after 10 Cross-validation

I applied 10 Cross-validation but I am a bit confused, I am not sure what is a correct way. 1- Should I apply 10 Cross-validation on all dataset, divide it into 10 folds and sum all the 10 matrices ...
184 views

### What attributes to apply laplace smoothing in naive bayes classifier?

I am reading naive Bayes classifier from the book "Data mining practical machine learning tools and techniques". The example of naive Bayes is given using the below dataset. As (Outlook=Overcast | ...
83 views

### gaussian naiive bayes with missing values?

I've got some data that I one-hot encode, A is numbers B is categories, C (the thing that I predict) is categories, so... ...
699 views

### Multinomial vs Gaussian Naive Bayes Performance in Scikit Learn for Word Embedding Features

I am running some experiments using word embedding features with Multinomial and Gaussian Naive Bayes in Scikit learn. As far as I know, Multinomial Naive Bayes works on features with distribution ...
102 views

### Adding features decreases performance of Naive Bayes Classifier

A bit of background. I'm new to predictive modeling but am developing a model for predicting A&E patients who will admit to Hospital. I have available 12 features, 2 continuous, the rest ...
Are there any online learning algorithm that do not depend on the order of arrival of the data ? I am looking for algorithms that, given a sequence of data $(x_i,y_i)_{i\in[1,n]}$ : Will produce ...