Statistical classification is the problem of identifying the sub-population to which new observations belong, where the identity of the sub-population is unknown, on the basis of a training set of data containing observations whose sub-population is known. Therefore these classifications will show a ...

learn more… | top users | synonyms

0
votes
0answers
7 views

Using partial AUC as Caret metric for cross-validation?

I'm evaluating a grid of tuning parameters using Caret with metric="ROC" for cross-validation. Is there any simple way to use as metric the area under the curve for an specified interval of the ROC ...
0
votes
0answers
7 views

undersampling and class imbalance

What Data Mining software ( like SPSS, Weka) can be used to check/ verify a new under sampling approach such that the new proposed approach yields best results than the rest???
0
votes
0answers
6 views

Use known output distribution to increase maxent classifier performance

If you know the distribution of your output, can you use this information to improve the performance of a maximum entropy classifier? e.g., I know that a gallery of pictures is 40% cats, 60% ...
1
vote
0answers
31 views

Regression models to only predict integers (instead of floating point numbers)?

I have a dataset that consists of about 50 different attributes. One of these attributes I want to predict, using the other attributes as features. The values of the attribute that I want to predict ...
0
votes
0answers
3 views

Is there a classified corpus to learn similarities in a citation network? [on hold]

I am trying to train an ML algorithm to calculate the topic similarity of scientific papers based on their structural similarity in a citation network (i.e. a graph where vertices are scientific ...
0
votes
1answer
16 views

Unconnected Linearly Seperable Classification

Consider classifying something like the case shown below (exagerated syntetic example): If this were a task to classsify into 3 groups, (blue-left, red, blue-right), then a Linear Support Vector ...
1
vote
0answers
21 views

J48 in Weka and R [on hold]

I tried J48 classifier in Weka to train the learner and got an accuracy of 99% but when I supply it with test dataset it threw me an error saying Training and Test sets are incompatible. I failed at ...
1
vote
3answers
40 views

Checking quality of clustering of labeled-class data

I'm performing clustering on a labeled dataset. I would like to check the quality of clustering. Is there a well accepted way of doing that? So basically I would like perform some classification-like ...
0
votes
1answer
28 views

How to do one-vs-one classification for logistic regression?

I have a dataset with 4 clases and I want to apply logistic regression with one-vs-one classification. So, first I train for each pair of classes a logistic regression classifier (i.e. calculate the ...
0
votes
1answer
32 views

Adaboost for numeric dataset

I have been trying to fit Adaboost to work with continuous valued data set and the more I read the more I keep getting confused. I have read about the multiclass Adaboost with log(K-1) addition to ...
1
vote
1answer
30 views

How to train lstm layer of deep-network

I'm using a lstm and feed-forward network to classify text. I convert the text into one-hot vectors and feed each into the lstm so I can summarise it as a single representation. Then I feed it to the ...
0
votes
0answers
10 views

Training and Activating a 2 layer deep network

I've been working with synaptic.js to make neural-networks in the browser for a while and I've decided I want to implemented deep-learning for a project I'm working on ( connecting an lstm to a ...
0
votes
1answer
17 views

How do Conditional Inference Trees do binary classification?

I am trying to learn about Conditional Inference Trees, and have been doing some very simple comparisons of the ctree() and rpart() functions in R. I have looked at the documentation for ctree(), but ...
0
votes
0answers
21 views

Time-series cross-sectional classification problem

I have a time-series cross-sectional dataset consisting of 100 individuals that each had 4 features measured yearly for 21 consecutive years. One of the features is binary and the other three are ...
0
votes
0answers
14 views

Noisy data in classifiers [closed]

I have a data set which has three classes(Labelled 1,2 and 3).However ,there is also noise in it. Should I classify with noise,so I will assign one more label to it (label 4) OR should I remove it ...
0
votes
0answers
15 views

Binary classification without positive samples

I have been given a trainingset of negative samples, and am asked to use this to classify a testset. I am aware of how classification can be done when you have some positive, and some negative ...
0
votes
0answers
12 views

Binary Classification of Labels with Similar Feature Distributions

I wish to classify gene interactions as 'Validated' and 'Unvalidated' based on certain features of each interaction. Each interaction has 10 different features. However, the feature distributions of ...
0
votes
1answer
63 views

Improving a logistic regression model in R [closed]

I have to devise a model in R, capable of predicting the type of a disease, which is a categorical dependent variable (three possible values), through several continuous and categorical, some of the ...
2
votes
1answer
70 views

Identification of navigation pattern (lapping, pacing, random and direct) from X,Y co-ordinate in known physical layout

I have X, Y and Z co-ordinate of the movement patterns of a person for 30 days over some known physical layout. This is unevenly spaced time-series data with maximum frequency of 2Hz while in motion. ...
1
vote
0answers
15 views

Can random forest be applied to predict an event rate for a time interval, for the following problem statement?

I have to predict which of the agents (in a direct selling business) could become sales leaders. This prediction has to be done just before every sales cycle (there are 2 week cycles across the year, ...
0
votes
0answers
34 views

What kind of data types are best to work with prediction algorithms of R

Assuming the data is tidy and it has a mix of columns of type numeric, character and Factor. What is the data type that would give best results when using different prediction techniques in R? I am ...
0
votes
0answers
16 views

classify objects into binned categories

I need to generate a model which is able to classify objects into binned categories. These categories are related to each other as they are bins of a continuous variable. Let's say predicted value ...
0
votes
0answers
10 views

Website classification using metadata features

I want to fit a model that predicts a website type according to metadata features that I manually collected, such as - Average text length, average # of pics, average outgoing links per page, etc... ...
1
vote
0answers
12 views

Which is the dependent variable in the UCI Liver dataset?

https://archive.ics.uci.edu/ml/datasets/Liver+Disorders lists some papers which have used this dataset. I went to one, Turney, and it says: The target concept was defined using the sixth column: ...
0
votes
0answers
14 views

Classify inventory part names into cost categories

I'm wondering if it's possible to do, and if so, how would I do it? I would like to create a model that could classify part names (inventory part names) to cost categories ('under \$1', '\$1 to 9.99', ...
0
votes
1answer
39 views

How to compute classification accuracy of PCA?

How to check classification accuracy for principal component analysis (PCA)? In order to compare it with different methods, for example with random forest classification, how can I compute accuracy? ...
1
vote
2answers
44 views

what is the difference between area under roc and weighted area under roc?

Thanks in advance for the help. I have an unbalanced dataset that I am using for a binary classification problem. The classes are unbalanced. I believe that in such a case that weighted area under ...
2
votes
1answer
43 views

Model to predict Residuals of another model

I am using a random forest for a 2 class classification problem. But eventually using probability of class "1" returned by the model for my task and not the label. I get AUC of about 70% Then I ...
2
votes
2answers
25 views

Data set for document topic discovery

I have a bunch of documents and would like to to assign one (or more) topics to each document. The topics can be quite wide ranging from political topics to sports, etc. I think the best way is to ...
0
votes
0answers
4 views

How to return multiple objects of a library in R? [migrated]

I'm using rpart library in R. In a function, I want to return an array of rpart objects which are generated in a for loop. However, I don't know which data structure I should use for storing rpart ...
10
votes
3answers
187 views

When should I not use an ensemble classifier?

In general, in a classification problem where the goal is to accurately predict out-of-sample class membership, when should I not to use an ensemble classifier? This question is closely related to ...
0
votes
0answers
2 views

MCCV + Bootstrap with R?

I have a matrix of 111 observations and 1196 numeric variables. Observations consist in Diabetic / NON Diabetic persons. I want to apply Random forest or SVM as classifiers, but before I need to know ...
0
votes
0answers
12 views

What method(s) exist(s) for the classification and reliability (Cohen's kappa) analysis of partial data?

I'm trying to set up a study in which I have many (about 700) images to classify. I need to measure expert judgements on this data set. Based on literature on the same subject, I am setting up a study ...
1
vote
2answers
38 views

How well should features discriminate to build a good classifier from them?

For my (binary) classification problem I'm developing several features and tune them with ROC curves. At some point, I want to combine them with in classifier. How well should the features perform, ...
1
vote
0answers
17 views

How to calculate F-measure with only Positive Data

I'm new in statistics and I have a question about finding f-measure once we do not have any "negative" data. I have a list of items with confidence score (between 0 and 1) calculated for each item: ...
1
vote
2answers
68 views

Is it right to consider the output of the neural network as its confidence in predicting the output?

Suppose I have a single output sigmoid (tanh) that is producing an output ranging [-1, +1]. Is it right to consider this output as its confidence measue of predicting the output. The output value ...
1
vote
2answers
54 views

How do I use Lasso and elastic net as feature selectors?

I have a data set with 900,000 rows and 8 features. I want to look at the significance of each feature so that I can evaluate whether the features I add are viable or not. One method I am using after ...
1
vote
1answer
28 views

How can I do a one vs all classification (binary classifier) with a neural network

I have a set of images that belong to a particular class. Then, I have another set of images that do not contain any image of the above particular class. So, effectively I have two sets of images ...
0
votes
1answer
25 views

How do I improve the accuracy of my supervised document classification model? [closed]

Given 1000 legal judgement documents, 900 of which are labeled, my task is to predict the label for the remaining 100 documents. The labeled documents belong to 41 different categories of Law, with ...
0
votes
0answers
10 views

Choosing keypoints for a training set and their prospective number

I am building a software to classify cells from images taken by a microscope. I have a dataset of images of cells to use as training dataset - I have extracted Keypoints from each image using ORB - ...
1
vote
0answers
12 views

How can I train HMM for continuous sign language recognition?

Currently I can recognize isolated words using HMM (Hidden Markov Model) through training an HMM model for each sign, and for a new word I take the sign for the model giving the highest likelihood. ...
1
vote
2answers
36 views

Categorical Predictors and categorical responses

I have a dataset consisting of 5 categorical predictors and a categorical response (class). I want to find out which predictor has an effect on the response. Additionally, I can't guarantee whether ...
1
vote
1answer
87 views

Wilcoxon signed rank test for comparing classifiers

I am interested in comparing Classifier A with Classifier B. I have obtained Micro-Averaged F1 measures for Classifiers A and B that I intend to compare pairwise. I want to find out if Classifier A is ...
2
votes
1answer
58 views

What balancing method can I apply to a imbalanced data set?

I'm trying to solve one classification problem from the UCI database repository. Unfortunately (or fortunately), I've noticed that my dataset is imbalanced. I've structured the data as 5 classes, ...
1
vote
0answers
17 views

what possile balancing method can I apply on a imbalanced data set? [duplicate]

Im trying to solve one classification problem from de UCI database repository. https://archive.ics.uci.edu/ml/datasets/Student+Performance Unfortunately (or fortunately) I've noticed that my dataset ...
1
vote
0answers
13 views

Help me with different formulations for SVM classification

I've been working with kernlab for more than a year now, but I always stickied to the vanilla cost (C-svc) formulation for ...
1
vote
0answers
10 views

Unbiasing One-vs-all

When you train a one-vs-all multi-class classification, the rule of thumb is that for each class (e.g. class A) mark it as class 0 and others as class 1. Then you split the data as you wish and train ...
0
votes
1answer
40 views

Did I understand ROC curves correctly?

I want to classify objects by their area into two classes. I implemented several area estimates that I want to compare. For each object, I have a gold standard indicating to which of the two classes ...
0
votes
0answers
28 views

What is the activation function, label and loss function for Hierachical Softmax [migrated]

Several papers([1],[2], [3]) suggest the use of Hierachical Softmax instead of softmax for classification where the number of classes is large (eg many thousand). I haven't been able to get clear in ...
0
votes
1answer
51 views

Multiple Correlation towards 2 target values

I am analyzing correlations between the driving speed of several drivers pairwise on the same route and correlations between them. ...