Statistical classification is the problem of identifying the sub-population to which new observations belong, where the identity of the sub-population is unknown, on the basis of a training set of data containing observations whose sub-population is known. Therefore these classifications will show a ...

learn more… | top users | synonyms

0
votes
0answers
7 views

Techniques to improve GMM-based binary classifier performance?

I'm currently training a set of 2 GMMs (Gaussian Mixture Models) for 2 classes of data (stressed speech vs neutral speech), and making classification decisions by comparing the posterior probability ...
0
votes
0answers
10 views

For classification w unbalanced datasets, is class-weighing the same as oversampling?

in unbalanced classification problems, I find myself using class_weigh = "auto" or similar parameters often, but I don't think I'm fully understanding what it's doing. I know that it's the industry ...
0
votes
2answers
13 views

How to analyse the accuracy and standard deviation of a neural network in matlab toolbox?

I am new in Matlab and neural network, and I am doing a prediction with some data that I found on the internet to learn more about it. Here is my function to create a neural network: ...
0
votes
0answers
4 views

What is the best way to analyse data comparing one by one and stipulate the accuracy?

Follow the example: The first line is the data I got. The second line is the target data. | 154.0 | 784.4 | 854.1 | 789.3 | | 153.5 | 789.7 | 892.3 | 903.2 | I ...
0
votes
0answers
9 views

understanding accuracy assessment of classification

I want to classify an image and I want to know how well I did, but I am not sure if I understand the workflow properly. I use scikit-learn. I first use cross_validate and GridSearchCV to find the ...
0
votes
0answers
14 views

Logistic regression in R, basing on which class(0 or 1) in dependent variable the modelling is performed

In R and in binomial logistic regression to be specific, the modelling is based on which class amongst 0 and 1? And if it builds model based on 1 by default, is there a parameter or something in which ...
0
votes
1answer
26 views

Python/R Exploratory Data Analysis for Classification

Are there preexisting functions in Python/R that create exploratory data analysis plots like the following:
1
vote
0answers
12 views

How to find the threshold that maximizes the F1 score?

I have a probabilistic, binary classifier. Is there any principled way to select the threshold that maximizes the F1 score? Currently I simply choose many different thresholds, apply them on some ...
0
votes
0answers
17 views

Naive Bayes - Good for Binary Data?

I have 92 observations with 92 variables. Every observation is a binary outcome (0=no, 1=yes), indicating if that observation co-occurs with a given feature in the feature set. I have 18 classes which ...
0
votes
0answers
14 views

working with entire census data of population distribution

i am working on the total population of a state using census data sets, please what statistical techniques can i use to analyse the data to test if the distribution of population within the state in ...
0
votes
0answers
9 views

Getting prob of class using naive bayes

I am trying to classify input with two classes, here is the simple code for the same. dino and crypto are two classes ...
0
votes
0answers
13 views

use of statistics in analysing census data [on hold]

Good day everyone. Please I need your urgent assistance. I am about to write a research project on the topic: The Application of Geographic information Systems In analysing Census data with regards to ...
0
votes
1answer
47 views

Standardization before applying ANOVA?

I have a matrix where the rows are the data points (samples) and the columns are the features. It is a multiclass (4 classes) problem. On this data I want to apply machine learning classifiers. But ...
0
votes
0answers
7 views

Deep classification, training vs inference phase

As I have described in Deep classification, how to represent category as TF-IDF vector?. I am trying to understand more in detail and reproduce the Deep classification for large scale taxonomy ...
0
votes
0answers
12 views

Deep classification, how to represent category as TF-IDF vector?

I am trying to implement so called deep classification method described here. I am trying to replicate chapter 4.2, with category-based search. Unfortunately, I am not sure how should I represent the ...
0
votes
1answer
14 views

How to score the predictions of a classification model?

I have made a classification model using support vector machine for the classification of two classes.The model is giving probability score and decision value for the test and training set and also ...
0
votes
0answers
25 views

Label outliers for anomaly detection

I am trying to detect anomalies using unsupervised learning techniques. However, I have the problem that it is impossible to generate controlled anomalies to use as a test set. My idea is to discover ...
1
vote
2answers
44 views

“Non-naive” bayesian classification algorithms

Based on the problem description in this post: Relating parameters to a measured variable Based on a suggestion, I thought of studying the relationship between the parameters and a measured metric ...
0
votes
0answers
23 views

Classifier that learns provided by only positive examples?

I was wondering if any of you has ever worked with classification/regression using only positive examples (one class). I would need such a system. The basic idea is that it is going to accurately ...
1
vote
2answers
29 views

Online learning that “forgets” older aspects learned? (short-term memory)

I am looking for an online learning classifier that is highly adaptable and has only short-term memory. I need such a think in a object tracking system with high-dimensional feature vectors. Maybe a ...
0
votes
2answers
25 views

Which data transformation can improve the performance of MLP neural networks for classification?

I am trying to fit several MLP neural networks models with a single hidden layer using the caret R-package. My main concern now is in the preprocessing step. My train data features (16 in total) are ...
1
vote
1answer
23 views

Best technology for keywords to features mapping

Source data = free text ("It's fresh and juicy and sweet") Pre-defined "knowledge" = "fresh" -> quality of a fruit "juicy" -> quality of a fruit "sweet" -> quality of a fruit "sweet" -> quality of ...
4
votes
0answers
32 views

Information gain and mutual information: different or equal?

I'm very confused about the difference between Information gain and mutual information. to make it even more confusing is that I can find both sources defining them as identical and other which ...
3
votes
0answers
31 views

SVM with non-negative weights

An SVM classifier can be obtained by solving the following, $\arg\min \frac{1}{2}\|W\|_2^2 + C\sum_i \max(0, 1-y_i (W^T\mathbf{x}_i + b))$ where $W$ is the hyperplane (or weights), $b$ is the bias, ...
1
vote
0answers
13 views

Advantages of using multiple lstm s in deep network

What are the advantages, why would one use multiple lstm s, stacked one side-by-side, in a deep-network? I am using a lstm to represent a sequence of inputs as a single input. So once I have that ...
0
votes
1answer
42 views

Is ROC or PR curve only the overall performance measure for classification

We can use ROC or PR curve to access the performance of the classifier,especially on imbalance data. But it is a curve with parameter threshold, even if we get a high ROC or PR performance, which ...
0
votes
0answers
13 views

How to use KL-divergence in naive bayes classifier to weight features?

I have a dataset consisting of 4 classes. I have implemented the Gaussian Naive Classifier (in Matlab). In the training phase I calculate the mean and variance for each feature and each class as well ...
0
votes
0answers
18 views

How to use Weight vector of SVM and logistic regression for feature importance?

I have trained a SVM and logistic regression classifier on my dataset. Both classifier provide a weight vector which is of the size of the number of features. I can use this weight vector to select ...
3
votes
1answer
25 views

How to use log probabilities for Gaussian Naive Bayes?

I'm currently implementing a Gaussian Naive Bayes classifier. Of course if I'm doing classification by $$ \text{argmax}_{C_i} P(C_i)P(D|C_i), $$ then the probabilities can get very small. So I want ...
1
vote
0answers
29 views

Adjust p-values for multiple comparisons

I want to evaluate if a proposed modification M* to a base classifier M is better in terms of accuracy. Both, the base classifiers M and their respective modifications M* are tested on N datasets. To ...
0
votes
0answers
17 views

How can I get feature importance for Gaussian Naive Bayes classifier?

I have a dataset consisting of 4 classes and around 200 features. I have implemented a Gaussian Naive Bayes classifier. I want now calculate the important of each feature for each pair of classes ...
0
votes
1answer
42 views

Why is LDA considered to be a classifier?

I am new to machine learning and I was reading about dimensional reduction algorithms like LDA(linear discriminant analysis) and PCA. Currently I am using LDA to find the optimal dimensions that ...
0
votes
0answers
17 views

Gaze estimation, choosing algorithm and parameters

I am trying to build a program for estimating point of gaze on the computer screen from the x and y coordinates of the pupil centres from webcam video .(x and y coordinates correspond to pixel ...
2
votes
0answers
32 views

Fisher LDA is a Bayes Classifier?

I've been going over many material in classification algorithms, and it seems that under the constraint that the covariance matrices are the same for a two-class problem then classifying a vector $x$ ...
0
votes
1answer
27 views

Proportional odds logistic regression with nominal (unordered) categories

Suppose that you've got a logistic regression with multiple nominal outcomes that cannot be ordered in a theoretically meaningful way. Assume further, however, that the proportional odds assumption ...
2
votes
1answer
34 views

“One sided” classifier

Below was tried in R, but any general solution would be highly appreciated: I have 2 class samples (both classes are balanced). I want to create a classifier, where I only care about 1 class (So, if ...
3
votes
2answers
139 views

Which unsupervised classification method to use next if hierarchical clustering gave bad results?

Purposes I need to perform a classification of weather stations taking into account the characteristics of intra-annual variability of some two climate indicators. There are 613 sites with monthly ...
1
vote
1answer
16 views

Training lstm a sequence one item at a time

I am trying to train an lstm with a sequence and get the sequence classification for the whole sequence. I have sequences of varying length so I have one input neuron and I am feeding one item at a ...
2
votes
1answer
15 views

Comparing performance of a single classifier on two datasets

I'm using a single classifier on two different datasets, consisting of non-overlapping set of observations. The performance on one dataset is higher than the other, and I want to show that the ...
1
vote
2answers
81 views

What measure of training error to report for Random Forests?

I'm currently fitting random forests for a classification problem using the randomForest package in R, and am unsure about how to report training error for these ...
2
votes
0answers
20 views

Problems with classification in imbalanced datasets

I often read about the problematic of doing classification in imbalanced datasets and methods to address it. Namely, off-the-shelf classifiers learn to minimize some form of total miss-clasffication ...
0
votes
1answer
32 views

Feature selection in a “Noisy” environment

My first question - This might be a basic question but I have yet to find an answer; when choosing the features for my model, I have encountered certain features which are vectors themselves. (e.g. ...
0
votes
0answers
41 views

How to quantify performance of Linear Discriminant Analysis (LDA)?

I have implemented Linear Discriminant Analysis (LDA) for dimensionality reduction in C. But I don't know how to quantify performance of the LDA. Could someone help me?
1
vote
1answer
32 views

Binary Classification vs Multi-class Classification

In the scenario that I have a binary classification problem, and use a binary classifier to train and test my model, assuming everything else is constant, would using a multi-class classifier with 2 ...
0
votes
0answers
31 views

Personal bet suggestor

Hi which regression or classification algorithm gives the best suggestions for future bets. i have a small training data base (approximately 50 data) consists my old BET coupons and old results. And ...
0
votes
0answers
8 views

How does the value of random state affect the prediction accuracy in sklearn?

I was doing a split on my train and test data for the iris dataset and trying to randomize it. I have the following code. ...
0
votes
1answer
10 views

classifications for many multiple classes (40)

I need to classify records in 40 different categories. What would be the best approach to it? Logistic regression? I though it is used for revealed preference and I don't have the other possibilities ...
0
votes
1answer
31 views

how to minimize the probability of error in a Bayes decision rule

According to the Bayes decision rule for a 2 class classification problem: $d(x) = w_1 : P(w_1 |x) ≥ P(w_2|x) $ And $P(error|x) = min[P(w_1 |x), P(w_2|x)]$ where $P(w_i |x) = p(x|w_i) * P(w_i)$ ...
0
votes
1answer
31 views

Classification trees: favor one classification over other

We're using classification trees (c50 package) for a BUY/WAIT advice. However, the advice in our training set is not well balanced. That is, we advice to buy 3/4 times more than to wait. Probably as ...
5
votes
0answers
45 views

why use diagonal $\Sigma$ when working with Bayes decision theory?

My prof. said in the class that for Bayes decision rule, the likelihood is Gaussian and in practice, we will almost always work with a diagonal $\Sigma$. Why is that? I know that a diagonal $\Sigma$ ...