Statistical classification is the problem of identifying the sub-population to which new observations belong, where the identity of the sub-population is unknown, on the basis of a training set of data containing observations whose sub-population is known. Therefore these classifications will show a ...

learn more… | top users | synonyms

0
votes
0answers
3 views

Should I perform parameter tuning on the balanced or imbalanced dataset?

Consider a binary classification problem. As far as I know, if the dataset is imbalanced and if the two classification errors are not equally serious, then we should balance the distribution of the ...
0
votes
0answers
5 views

Identifying important differences between supervised learning datasets

The training data in a multi-class supervised learning task shows a significant dependence on time that is apparently not captured well by my learners. Specifically, the two learners I used (OvR ...
0
votes
1answer
16 views

Computing the Interaction gain. Is there an Error in the infotheo package in R?

In order to implementing a certain feature selection method for a classification problem I need to estimate the the interaction the interaction gain between two features and the target variable which ...
1
vote
1answer
29 views

Can a confidence interval be greater than 1?

I am doing a classification task and obtain an accuracy of 97.5%. Now, I calculated the confidence interval, assuming a normal distribution, at the 95% confidence level with: Accuracy +/- ...
0
votes
0answers
7 views

How to test if data imbalance affects classification results

My data is imbalance with say 80% of class A and 20% of class B. Training and Test results look OK e.g more than 90% of accuracy for both classes. Assume I want to improve the results. I wonder if ...
0
votes
0answers
31 views

Build HMM of text data in R

I'm trying to make my own HMM tagging in R but don't know how to estimate parameter values since the packages I have been working with haven't worked with my data. The latest package I have been ...
1
vote
0answers
13 views

What algorithm or implementation would classify a set of data into one of two groups? [on hold]

My data is in the form of long lists of integers of indeterminate length and where the position/order of the integers in the list doesn't matter, which can be assigned to one of two categories. E.g. ...
2
votes
0answers
24 views

PCA to decorrelate and classify timeseries

I have a labeled dataset where each subject belongs to one of two classes A or B, with A ...
2
votes
0answers
17 views

which classifier to choose for probability histogram-like features

I have a populations of 500 elements. Each element is represented by a 10 dimension feature vector which sum of element is equal to 1 (you can think about it as a histogram of probabilities). In ...
0
votes
2answers
24 views

Classification with a neural network when one class has disproportionately many entries

I try to train a neural network using a dataset with several classes $c_1, c_2, \dotsc, c_{10}$. The class $c_1$ has a lot more entries in the training set than the other classes, and this makes my ...
0
votes
0answers
37 views

Confused Scikit results

I am doing classification machine learning on a particular dataset on which an SVM model (using Scikit.learn) is giving a Matthew's correlation coefficient (MCC) of ...
3
votes
1answer
13 views

How to deal with data in which users_ids belong to more than one category (Multilevel) using Random Forest?

I know it sounds trivial, but I could not find any ready answers for this. Suppose we have this kind of data and we want to predict some target values for several users. ...
0
votes
1answer
31 views

Classifier performance [on hold]

I have some data that are training data. the feature size of training data is n but feature size of my test data is m. which one of classifiers can do classify this data?
0
votes
0answers
17 views

Evaluating performance Neural Network embeddings in kNN classifier

I am solving a classification problem. I train my unsupervised neural network for a set of entities (using skip-gram architecture). The way I evaluate is to search k nearest neighbours for each point ...
0
votes
0answers
18 views

How to calculate multi class classification AUC with labels? [on hold]

I am using pROC (in R) with the function multiclass.roc as pointed out at the thread How to plot ROC curves in multiclass classification? However, when I applied ...
2
votes
0answers
20 views

Converting between different accuracy/error metrics

I am trying to compare model accuracy between several different measurement metrics. For example, some citations use accuracy while other use error. That one is rather obvious, but there are lots of ...
0
votes
0answers
9 views

Classification techniques for handling mislabeled data

I am trying to think about a problem of how to model binary data in the presence of possible labeling errors and was curious if anyone had any thoughts about it. The basic setting is that we have a ...
0
votes
0answers
10 views

Can I compute ROC AUC of F-measure for multi class classification? [duplicate]

I know ROC AUC is computed for binary classification, as well as F-score. But for multi - class classification, is it possible to calculate ROC AUC or F-score?
0
votes
0answers
14 views

Training Data For Job Title Classifier [on hold]

I'm going to build a classifier for job titles and need training data. I currently scrape hundreds of resumes by the subject area of a person's degree, such as "physics". I then gather work ...
0
votes
0answers
14 views

How many percent in classification accuracy could be considered as significant

I have 2 classification methods to classify 6 classes. The method 1 achieved the accuracy = A1%, and the method 2 achieved A2%, with A2 > A1. How many percentage point between A2 and A1 could be ...
0
votes
0answers
10 views

Difference between Nearest Neighbour and Nearest Centroid

I'm trying to understand the difference between Nearest neighbour classifiers and Nearest centroid classifier. Using the nearest neighbour, one selects a data point ...
5
votes
0answers
32 views

State of the art in general learning from data in '69

I'm trying to understand the context of the famous Minsky and Papert book "Perceptrons" from 1969, so critical to neural networks. As far as I know, there were no other generic supervised learning ...
1
vote
2answers
46 views

Is decision tree output a prediction or class probabilities?

A Random Forest works by aggregating the results of many decision trees. Recently, I was reading about how the RandomForest aggregates the results, and it made me question whether the results from ...
0
votes
0answers
5 views

How to compare multiple non-hierarchical classications of the same dataset

I'm a taxonomist working on an identification consistency project in which a couple dozen researchers were asked to manually classify the same set of images into like groups. Each classification will ...
1
vote
2answers
45 views

Classifying time-series similarity - what variable should I train on?

I have ~10,000 time series, each with 65 time points. I'm interested in classifying each pair of time series as "similar" or "not similar". Here's an example of two similar (left) and not similar time ...
0
votes
1answer
48 views

data normalization after dimension reduction for classification

The classifier is KNN or RBF-SVM. After doing dimension reduction (e.g., PCA, LDA or KPCA, KLDA), does it need to do normalization before classification? In LIBSVM ...
-1
votes
0answers
17 views

Automatic mail classification

I'm building a mail classifier in Python 3. I've successfully built classifier to classify spam/ham using SVM (LinearSVC to be precise) using scikit-learn. But the next challenge is to auto bucket the ...
2
votes
1answer
71 views

detect incorrect term in group of terms

I obtain a 'group' of numbers every day. Each number is associated with a 'term'. eg 35 is Big Data. 42 is Hadoop, 82 is Zebra, 89 is Python, 3 is Machine Learning, and 6 is Waterfall, etc. I want a ...
0
votes
0answers
23 views

List of R packages for binary classification that support custom misclassification costs [closed]

I am looking for a list of R packages for binary classification problems that let users set custom misclassification costs for an error on each class. In particular, the packages have to be current, ...
0
votes
1answer
18 views

Logistic regression using ANOVA kernel in SKLearn?

In RapidMiner, you can run a logistic regression classifier with multiple kernel types. I see no options in sklearn.linear_models.LogisticRegression. Does anybody ...
0
votes
0answers
16 views

Valid procedure for binary classification with cross validation

I have inherited a classification model for a binary parameter and have been asked if estimates can be improved. From this model, an equation has been put into some software for predicting this ...
3
votes
2answers
25 views

Features, samples, and over-fitting?

I have a data set with 30 samples, 2 classes, and 100,000 features. When I run an SVC classifier on it from SKLearn using stratified cross-validation, the accuracy is barely better than chance. After ...
0
votes
1answer
15 views

Ground truth Vs. Baseline [closed]

I was wondering what the difference between ground truth and baseline is? Is it necessary that a system should always be tested ...
0
votes
0answers
25 views
+50

Interpretation of partial dependence plots for multinomial GBM

I've been a big fan of the gbm package for some time, but am having difficulty understanding the output from the partial dependence plots in the case for multinomial classification problems. Below ...
0
votes
0answers
6 views

Content Based Document classification

I have a corpus of 10 million resumes. I want to add tags to these resumes like Software Engineer, Data Scientists, ...
0
votes
0answers
22 views

How to compare the feature importances produced by two different classifiers?

In one study, I am using two different classifiers. I want to compare the feature importances produced by two classifiers. Is there a statistical technique to measure the similarity between the two ...
0
votes
0answers
8 views

Junk data in classification

I have a data set which I would like to classify it into two classes. And I have training data for each of those classes. However there is also junk data which I also have some samples but since it's ...
0
votes
0answers
7 views

How to decide optimal Components in Probablistic Independent Component Analysis?

I want to test Probablistic Independent Component Analysis (PICA) in case of streaming data, thus i need to decide the optimal number of indipendent components.For IPCA how to decide the optimal ...
1
vote
1answer
33 views

neural networks - Inputting a time series to a classification NN

I have a simple ANN that does the job of classification between two labels-: Sick Healthy What I want to do is that input patient data ie. heart rate(ECG), EEG, etc which will be in the form of a ...
-1
votes
1answer
22 views

Big data set for Document Classification [closed]

I'm looking for big data set which is suitable to be used for document classification task. The data set which I'm looking for should composed of the frequency of the words which exist in each ...
1
vote
1answer
31 views

Metrics for one-class classification

how do you calculate precision and recall in one class classification? In other words in one class classification , we just have TP(True Positive) and FN(False Negative).Which metrics we should use ...
1
vote
1answer
30 views

SVM classifier - can I average multiple models?

I'm performing SVM classification on a relatively large data set (~1M rows, 4 variables). I want to assign a classification score to each row, not evaluate input parameters, so following the top ...
0
votes
0answers
98 views

Email open-rate optimization

I am trying to maximize open rates of emails by selecting between two subject headlines {h1, h2} for a marketing campaing. The hypothesis is that different customers react to different headlines. ...
0
votes
0answers
17 views

Analysis and Processing of Time Series Data

My project requires me to accurately analyze several (15) financial time series data - Indicators. The data consist mostly of several variants of moving average and stochastic information (ie ...
0
votes
0answers
35 views

omit variable to find feature importance in classification

I have not seen the following idea about measuring feature importance in classification discussed. Fit model with all variables; get full model classification accuracy Successively fit the model ...
0
votes
0answers
24 views

How to analyze repeated measurements with categorical/ordered outcomes

I have the following dataset: 100 indiviuals (id) Each individual with 4 measurements at 4 timepoints time1,time2,time3 and time4 Outcome is a categorical or ordered variable 1,2,3,4. I simulated ...
0
votes
1answer
18 views

Performance evaluation measures for binary random forest classifier

I am using Random forest (Matlab) to classify the binary data. Broadly, the input to the random forest is number of features and class label. And random forest, after training, return the labels for ...
1
vote
1answer
27 views

Is it possible to do random forest with multiple responses or combine such ensembles for multi-label classification?

I have a dataset which has numerous nominal responses, and many predictors. Each response is basically a pass/fail check of a certain test applied to the data. Multiple methods are applied to each ...
0
votes
1answer
19 views

Test accuracy is lower than the validate accuracy in classification

I separated my data set into three parts includes training, validate, and testing. I performed k-fold validation with using the validate set, then test the true performance of the predictive model ...
3
votes
0answers
31 views

Cut off point with three categories

I have a categorical variable called severity with three categories (low, medium, high) and another numerical variable call ZX that can take values from 0 to 10. I want to find the cut off points of ...