A naive Bayes classifier is a simple probabilistic classifier based on applying Bayes' theorem with strong independence assumptions. A more descriptive term for the underlying probability model would be "independent feature model".

learn more… | top users | synonyms

1
vote
0answers
18 views

Suspicious Amount of Zeros in Confusion Matrix

I have a data set with about 45000 observations and three features. When I apply machine learning classification algorithms like naive Bayes, kNN and SVM I receive a lot of zeros in the resulting ...
0
votes
0answers
24 views

Why can I use the posterior probability of a classifier as a new classifier?

I have read that, when doing discriminant analysis, you can use the posterior probability you obtain using your classifier as a new fine-tuned classifier. Can anyone talk me through the rationale of ...
1
vote
1answer
44 views

Linear discriminant analysis (Fisher) = Bayes?

I'd like to ask a question, I am reading book right now about mail filtering, both methods: naïve Bayes and Fisher are there very similar in implementation. I am also writing a paper on Bayesian spam ...
0
votes
1answer
29 views

Naive Bayes Binary Classification with Binary Features

I have a dataset with two classes $C_0$ and $C_1$. I have around $10$ to $20$ features that take binary values (either $0$ or $1$). My dataset has around $10000$ instances, with only a hundred of ...
1
vote
1answer
36 views

Can adding an additional feature to a perceptron classifier make the results worse?

I am using perceptron to solve a classification problem. I have a limited amount of features (26) and iterate through all possible combinations of them. A combination of two features [feature_a, ...
1
vote
0answers
18 views

How could these two simple Bayesian algorithms be explained, simply? [closed]

count(this token in class) + 1 / count(all tokens in class) + count( all tokens ) and ...
0
votes
1answer
13 views

Choosing smoothing parameters across multiple Naïve Bayes classifiers with different number of categories

I would like to train multiple Naïve Bayes classifiers with different number of categories, and also have a global threshold for how certain one classifier must be in order for the classification to ...
0
votes
0answers
19 views

K-cross validation and Naive Bayes

I am doing an exercise of machine learning, and I have built a Gaussian Naive Bayes classifier (i.e., I have defined values of mean and standard deviation) using scikit-learn. Now I am supposed to ...
1
vote
0answers
35 views

Is possible classify audio file using naive bayes?

I like use naive bayes classifier to classify audio file (.mp3). I use Key, Mode, Loudness, Energy and Tempo as feature. So, the classifier will classify new file to 2 class, they are POP and ROCK. ...
0
votes
0answers
7 views

Classifier with interchangeable features

I have a situation in which the features used in a classifier are multiple instances of the same kind of measurement, in random (or unknown) order; thus, a sample x1, x2, ... xn -> classA could with ...
0
votes
1answer
97 views

Buiding Ensemble model

I'm new to ensemble model. Suppose I've KNN models like this - (in R) library(class) ...
0
votes
0answers
10 views

Naive Bayes in text classification - Only classifying “0”

I have a data set of 1000 Amazon "art" category reviews. I want to classify Positive +1, Negative -1, Neutral 0 Ratings using user reviews. The final Naive Bayes classifier only predicts 0 for all ...
1
vote
1answer
35 views

How to use Naive Bayes for multi class problems?

I know how Naive Bayes work for classifying binary problems. I just need to know what are the standard way to apply NB on multi-class classification problems. Any idea please?
2
votes
2answers
141 views

How is Naive Bayes a Linear Classifier?

I've seen the other thread here but I don't think the answer satisfied the actual question. What I have continually read is that Naive Bayes is a linear classifier (ex: here) (such that it draws a ...
0
votes
0answers
23 views

Values of PDF in Bayes Classifier

I'm new here and also a beginner in statistics. I'm implementing a Bayes classifier for two classes but get confused with the value of likelihood (pdf). $$P(c|o) = p(o|c)\cdot P(c)/p(o);$$ Here ...
1
vote
0answers
42 views

Bias and variance of a naive bayes classifier and KNN classifier

After reading the paper by J. Friedman, ”On bias, variance, 0/1-loss, and the curse-of-dimensionality,” Data Mining and Knowl- edge Discovery, 1997. I would like to estimate both bias and variance ...
0
votes
0answers
25 views

Fisher's linear discriminant VS naive bayes

i know some basic things about linear classifiers. i prefer two think geometrically about them. and what'll happening if covariance Matrix were different things. Generally; What's the difference of ...
0
votes
0answers
43 views

Accuracy increases using cross-validation and decreases without

I have a question regarding cross validation: I'm using a Naive Bayes classifier to classify blog posts by author. When I validate my dataset without k-fold cross validation I get an accuracy score of ...
1
vote
0answers
22 views

sklearn - Multinomial Naive Bayes (data too big???!!!)

I wanted to really understand the rationale behind the following code as written in python sklearn's manual partial_fit(X, y, classes=None, sample_weight=None) when the data is too big to fit in ...
0
votes
1answer
32 views

From Naive Bayes to “real percentages”

I am working on a problem which is well suited to be solved with a Naive Bayes classifier: I want to know if a certain instance belongs to a certain class. I have three attributes that can help ...
1
vote
0answers
43 views

predict sales using naive bayes and handle sparse data problem

Problem I am trying to use naive bayes for ranking products in a search application. I would like to predict the sales of a given product given the search keyword and the category. the current formula ...
0
votes
0answers
28 views

Is Naive Bayes robust?

We know that according to Naive Bayes assumption input features are assumed to be independent of each others given the target variable $y$. Now, If we intentionally add a duplicate (exact copy of ...
2
votes
2answers
101 views

Naive bayes with duplicated data

In the training set for naive bayes, there are some duplicate samples. Should we train the naive bayes with duplicate samples, or should we eliminate all the duplicates and then train the naive bayes. ...
0
votes
0answers
27 views

To interpret SVM's probability output in text analysis

So, my question is about the application of the SVM's (or naive Bayes') probability output (via Platt's scaling). I know the interpretation of the output is the probability of a given observation ...
0
votes
1answer
33 views

How to deal with mixture of continuous and discrete features when using Naive Bayes classifier

My task is to use Naive Bayes classifier for prediction, where I have both continuous and discrete variables as predictor variables. In literature the classifier is written as: $$\hat{y}= ...
1
vote
0answers
71 views

Is the Naive Bayes family of classifiers linear?

There are a lot of places where you'll see the proof that Naive Bayes classifiers are linear, like this and this. But they always assume a special case of the family of Naive Bayes classifiers which ...
1
vote
0answers
31 views

Naive Bayes text classification on different cardinality classes

I have written a Naive Bayes classifier (with Laplace smoothing) and am using it to classify text into a few simple classes. However, I found that the classes are not of the same vocab size -- to be ...
0
votes
0answers
163 views

Can a Naive Bayes Model predict using pattern alone?

Say I have a set of data abc-def-ghi jkl-mno-pqr stu-vwx-yza and lots of other training samples which are catagorized as **names*. The above dataset does not have ...
0
votes
0answers
32 views

Is Laplace smoothing still good when the class sizes are unbalanced?

I'm thinking about text classification problems using naive bayes. Laplace smoothing is often recommended to eliminate zero probabilities. Let's assume that there are only two classes: A and B. ...
0
votes
0answers
27 views

Normalization of Naive Bayes output

In Scikit-learn documentation it is possible to see that the MultinomialNB estimator has a method called predict-proba in which it has the following description: "Returns the probability of the ...
3
votes
1answer
48 views

Deriving the Bayes Filter Correction Equation

The correction rule for Bayes filters is: $$p\left(x_{k}|D_{k}\right)=\dfrac{p\left(y_{k}|x_{k}\right)\cdot p\left(x_{k}|D_{k-1}\right)}{p\left(y_{k}|D_{k-1}\right)} $$ For: State at time $k$ is ...
1
vote
1answer
131 views

Text Classification using TfIdf and Bernoulli NB

So, as I am reading about Bernoulli distribution and text classification, I want to understand how Bernoulli uses TfIdf features? Since TfIdf values are within [0-1) but Multivariate Bernoulli assumes ...
0
votes
1answer
319 views

Request: Clever Things to do with Naive Bayes

I am trying to drive up the performance of a Naive Bayes classifier, and I haven't been having terribly much luck. I've been working in Weka, but have enough knowledge of R to (possibly) implement ...
0
votes
0answers
50 views

Decision function for BernoulliNB classifier. ( for use in plotting ROC and PR curves )

I would like to plot the PR curve using scikit-learn for the Bernoulli Naive Bayes estimator. However, attempting to do so give an error, ...
3
votes
0answers
86 views

Explanation for large difference in SVM and Naive bayes results

I have a dataset with 389 data evenly distributed into 6 classes. Each data has 1024 features. So my dimension is much larger than my observation data. I have tried to see some common classifiers on ...
0
votes
0answers
146 views

Naive Bayes Nearest Neighbor (NBNN) implementation problems in MATLAB

I'm currently trying to classify the CIFAR-10 image dataset. I cam across a number of papers praising the the results from a non-parametric approach called Naive Bayes Nearest Neighbors. It uses SIFT ...
1
vote
0answers
92 views

Alternatives to Non-Linear Regression

I'm not a professional statistician but I frequently work in the area of data analysis using R and Python, and frequently use linear regression models (OLS) or quantile regression, and tree based ...
1
vote
2answers
93 views

Balanced datasets in Naive Bayes

In a classification model, a desirable situation is to have classification classes evenly represented in the training dataset. Datasets that satisfy this property are called balanced datasets. ...
1
vote
1answer
39 views

Biasing SkLearn Algorithms to Positive Outcomes

I am trying to run multinomial naive bayes on a series of examples in python using sci kit learn. I am consitently getting all examples classified as negative. (The ratio of positives to negatives in ...
1
vote
0answers
26 views

fragmentation problem in decision tree

I am taking a NLP class, in which it says decision tree has the fragmentation problem. It says ...
2
votes
2answers
115 views

How to prepare a dataset for text classification

I would like to compare some algorithms for performing sentiment classification (Naive Bayes, SVM, and ...
0
votes
1answer
77 views

define prior probabilities in naive bayes with unbalanced classes and asymetric cost

I'm trying to apply Naive bayes to the following supervised problem: It's a binary classification problem The classes are unbalanced. The target class represents the 0.004266432 of the total and the ...
0
votes
2answers
148 views

Predict interesting articles: increase accuracy

I'm trying to write a GUI to display articles, and predict which articles I could like, based on the articles I previously liked. This post is the continuation of this one: ...
3
votes
2answers
113 views

Can $p(Y|a,b)$ ever be equal to $p(Y|a) \cdot p(Y|b)$?

This strikes me as a simple question, but in re-visiting how the Naive Classifier works I started wondering if there is any probabilistic model that under certain independency assumptions obtains: ...
0
votes
0answers
23 views

Naive Bayes Produce Confidence

I am pretty newbie in machine learning. Please forgive and point out anyone incorrect use of terminology. Now I am learning Naive Bayes algorithm. As I have learned Neural Network, when predicting, ...
0
votes
0answers
43 views

Naives Bayes example walk through

My instructor have give me an example that I didn't really understand, can someone help me in understanding it? Given a list of occupation and a list of grocery bought I want to recommend a list of ...
0
votes
0answers
31 views

Regarding Naive Bayes and conditional independence

We all have been talking about how Naive Bayes may, in some cases, not perform well due to the fact that this assumes conditional independence of features and MOSTLY, this is not true for real world ...
0
votes
0answers
97 views

Which naive Bayes?

I am attempting to use a naïve Bayes classifier in python (using scikit-learn), with two examples. The first example has 6 classes and 2 hypotheses, the 2nd example has 2 classes and 6 hypotheses. ...
0
votes
1answer
33 views

Turning categorized output into continuous

I'm using a NaiveBayes algorithm that generates categorized probabilities as output instead of continuous values, which is what I need for this webapp I'm working on. Unfortunately I can't switch ...
-1
votes
1answer
54 views

How to choose the right model after k-fold cross validation is done?

I'm using naive bayes to classify tweet into three classes. and i want to use k-fold cross validation to predict the right model, but i'm confused how to choose the right model after k-fold validation ...