0
votes
1answer
10 views

Weka java API: Attribute Selection and Cross Validation

Is there a way to perform Attirbute selection(aka feature selection) (regardless of method) only for the training dataset before passing data for Cross Validation ? I currently think that the only ...
0
votes
0answers
9 views

Unsupervised feature learning from raw text as a previous step for clasification?

I have a corpus of 2500 opinions, is it posible to use scikit´s restricted boltzmann machine implementation to extract a feature vector as a previous step to a classification task?. What aproach do i ...
0
votes
0answers
9 views

Feature selection based on cost function

Suppose that we are searching for best features using an optimization algorithm for a classification model (MLP,SNM,Regression,etc...). We should set a cost ...
0
votes
0answers
34 views

different feature types for classification

There has a data set with several features. One feature is of the type of continuous numerical values; another feature is of the type of categorical values, such as A, B and C. If I want to build a ...
1
vote
0answers
32 views

categorical feature ranking

I would like to rank categorical features by the order or importance in a classification/regression setting. Input There are two features, which are survey questions: "how is your mood?": four ...
0
votes
0answers
10 views

How can the quality of features be evaluated in high dimensional classification tasks?

I am currently experimenting with on-line symbol recognition for mathematics for my bachelors thesis. I have 369 symbols which I would like to distinguish. There are a lot of preprocessing methods / ...
0
votes
0answers
19 views

How many features can be used for classification?

Asked a similar question the other day without an answer Link. I think maybe the question there is too big. Here I want to ask a specific one: 2 Class labels (Binary classification labelled with ...
0
votes
0answers
30 views

How many features to overfit the classification?

Recently, I have got some 'strange' comments from the reviewer of my paper. In my paper, I discussed a novel feature extraction method, and then I compared three classification methods for my binary ...
0
votes
0answers
11 views

Feature selection: all features vs a subset of them

I am doing a binary classification. The dataset has 3000 samples, and each sample has 10 features. But I find that the performance of using all 10 features is almost the same as that of using only the ...
1
vote
1answer
92 views

Maximum Entropy Model for classification, what to use as context & feature?

I'm building a Maximum Entropy Model to classify some text, based on paper "A Maximum Entropy Approach to Natural Language Processing" by Berger et.al. It's similar to POS tagging. Below is some ...
0
votes
1answer
47 views

Feature Normalization/Standardization before or after Feature Selection?

Should the process of feature normalization/standardization be done before or after the feature selection process?
0
votes
2answers
79 views

Best feature selection method for naive Bayes classification

i want to make classification with naive Bayes. I have got about 100 Features. Numerical ones as well as categorical ones. Since i want only the most relevant ones to be included for the ...
0
votes
0answers
27 views

TF-IDF for text classification by taking into account the document class

I am looking for a TF-IDF weighting for text classification (not document ranking/retrieval) which takes also into account the document class. For example let's use the typical spam/not spam ...
1
vote
0answers
50 views

How to apply feature selection based on tf-idf threshold

Let's say we have the following matrix (typical VSM example): ...
0
votes
0answers
18 views

Replacing categorical variables with historic response rate

In Linoff and Berry's "Data Mining Techniques" they mention reducing the number of categorical variables in a classification model by replacing the variable with the historic response rate. "When ...
1
vote
1answer
25 views

Using selected features from a wrapper algorithm to train another model

I was wondering if it can be useful to use selected features from a wrapper algorithm (for example SVM-RFE) to train another classification model like k-NN or Linear regression.
0
votes
0answers
326 views

HOG Feature Implementation with SVM in MATLAB

I would like to do classification based on HOG Features using SVM. I understand that HOG features is the combination of all the histograms in every cell (i.e. it becomes one aggregate histogram). ...
0
votes
0answers
217 views

HIstogram of oriented gradients (HOG) features descriptor theoretical problems

I'm going to implement HOG as my features descriptor. But there are some things that make me confused: For example: If we have an image with size of 10 x 20 If we want to compute the HOG of that ...
1
vote
0answers
40 views

What are some classic examples of feature selection in classification?

Is there a classic example showing the importance of good feature selection in classification? The ideal example would be simple, and very easy to understand. I've been volunteered/instructed to put ...
0
votes
1answer
80 views

What is parameter fine tuning means in SVM?

I got this sentence in one of paper, but I dont understand what does it mean?? "Training a learningbased classifier such as an SVM on an imbalanced dataset often requires parameter fine-tuning, ...
0
votes
0answers
27 views

Detecting noisy patterns in document images

I am looking for features to extract to distinguish between text objects and arbitrary noisy patterns in degraded document images. This is an example of a document with some parts of noise, I have ...
0
votes
1answer
155 views

Good algorithms for feature extraction from images?

I am searching for some algorithms for feature extraction from images which I want to classify using machine learning . I have heard only about [scale-invariant feature transform][1] (SIFT), I have ...
0
votes
1answer
45 views

How to compare features and classifiers which achieve perfect accuracy?

So I'm looking to compare different combinations of features and classifiers. But I'm getting a lot of combinations that achieve 100% cross validation accuracy. I'm trying to figure out how I would ...
3
votes
3answers
52 views

How to compare features and classifiers which achieve perfect accuracy?

So I'm looking to compare different combinations of features and classifiers. But I'm getting a lot of combinations that achieve 100% cross validation accuracy. I'm trying to figure out how I would ...
2
votes
1answer
46 views

Feature selection while retaining a specified feature

Pardon if this question is very basic, but I am not able to find any solution for my problem. I am trying to run a feature selection scheme on N features for my classification model, however I want ...
1
vote
0answers
55 views

Music classification into genres

I need to classify music (songs) into genres (rock, french house, trash metal, etc). My idea was to extract features from the songs (bmp, zero crossing, etc) and then apply known classification ...
1
vote
0answers
64 views

Classifier predicts only one class

I was trying myself in kaggle CIFAR competition, I trained lots of classifiers but get the same result/fail (don't know how to treat them), maybe someone could help me figure what i'm doing wrong. ...
3
votes
1answer
685 views

Understanding the output of C5.0 classification model using the CARET package

The C5.0 classification model was used in this 4-class problem data with $N_{train}$=165, $P$=11, using caret R-package by ...
1
vote
0answers
30 views

Estimating confidence of a prediction

Given a set of features vectors $X=\{\vec{x}_1,..,\vec{x}_n\}$, binary ground truth data $Y=\{y_1,..,y_n\}$ and continuous prediction $\bar{Y} = \{\bar{y}_1,..,\bar{y}_n\}\in [0,1]$, I want to perform ...
1
vote
0answers
79 views

Feature selection methods comparison

I recently run a project that involves a feature selection step before further pattern recognition. The number of features for our data set is very large and instead of running greedy ...
2
votes
1answer
231 views

How to interpret this cross-validated sparse LDA figure using CARET package?

Training data with $p$ =11 predictors and $n$ =165 with 4-class problem was cross-validated (5 times repeated 10-fold CV) using the sparse LDA (aka SDA) using caret ...
2
votes
2answers
168 views

Selecting a feature modeling approach for text classification

I am new to text processing. Currently I am trying to determine which type of feature vector I need for a classification problem. I am mainly deciding between binary feature modeling and ...
0
votes
2answers
76 views

Choosing the best featureset for prediction

I have this N sets of features F each with $F_i$ number of features. All the feature sets have 20000 examples and we have 20,000 labels for them. Lets say feature set $F_1$ has 10 features and ...
2
votes
2answers
120 views

improve precision in text classification

I am working on binary text classification using sklearn: The length of each sample is not high (~ 200-500 characters) I use TF-IDF to get important words as TfidfVectorizer(sublinear_tf=False, ...
1
vote
0answers
50 views

Inferring dimension weight in a mapping from a triangle to a distribution over its vertices

I have a dataset $(y_i, \mathbf{X}_i)$, where $\mathbf{X}_i$ is a $3 \times n$ matrix of reals and $y_i$ takes a value in $\{1, 2, 3\}$. Essentially, $y_i$ represents a "selection" of the row vector ...
0
votes
3answers
92 views

Classification performance and the feature set selection

I am now working on a classification problem. The generated feature set can be separated into two group. I did a comparison study: use all of the features; use the features of group 1 only; and use ...
0
votes
0answers
15 views

How to find entropy of vocabulary terms in multilabel document classification problem?

I have 5 million of document s with varying number of labels for each. I intent to find entropy value for selecting discriminative terms to degrade the size of vocab. However, having that multiple ...
1
vote
0answers
73 views

How to explain difference of importance between feature selection and model quality?

I have a data collection with a mixed feature set consisting of both numerical features and text features. The number of numerical features is quite small, i.e., 6, comparing to the number of text ...
2
votes
1answer
119 views

Number of samples vs Number of features

I've got a set of two classes with 4000 observations total. I've a set of 63 features to construct a predictor. My question is, is there a relation that would prevent overfiting for having too much ...
1
vote
0answers
31 views

How to use reservoir states for readout and training?

I’m trying to make a Liquid State Machine, I have a spiking neural network as the liquid, and a feedforward neural network that should learn to map the reservoir’s states to the output. I’ve read ...
8
votes
4answers
2k views

Test accuracy higher than training. How to interpret?

I've a dataset containing at most 150 examples (split into training & test), with many features (higher than 1000). I need to compare classifiers and feature selection methods which perform well ...
3
votes
1answer
444 views

Can we use random forest for classification in combination with distance matrix between classes?

With a colleague, we are working on a dataset containing ~5000 continuous variables for 120 individuals belonging to 8 classes. We want to estimate the relative importance of each variable to explain ...
2
votes
1answer
300 views

Features selection using F-score for multiclass classification

I'm going to implement a feature selection algorithm, and I plan to use the F-score for because of its simplicity. The problem is that, the F-score is used for binary classification. How can it be ...
1
vote
1answer
40 views

Finding similar users

I am working on a problem in the online advertising space. I am trying to identify consumers similar to the set of consumers who have bought a product in the past (have 'converted'). If I can identify ...
1
vote
0answers
100 views

True and false discovery rate in variable selection

I have a question about how I can calculate true and false positive rate in a simulation study? I have seen some articles and thesis by different definitions. One of them is the following one: ...
2
votes
0answers
39 views

Why do correlations matter in simulating data to compare classifiers when p >> N?

In genomics and computational biology, expression data sets contain a much larger number of features (p) than the number of observations (N). I wanted to simulate data where p>>N to compare the ...
2
votes
1answer
73 views

A buggy but effective feature?

Through error analysis I found that a quite effective feature actually has bugs in its implementation. Correcting the bugs actually decreased the classifier's performance. What do you do? Correct the ...
9
votes
4answers
1k views

Features for time series classification

I consider the problem of (multiclass) classification based on time series of variable length $T$, that is, to find a function $$f(X_T) = y \in [1..K]\\ \text{for } X_T = (x_1, \dots, x_T)\\ ...
1
vote
0answers
129 views

Number of features and accuracy/f-measure - Who can explain this results?

I'm performing a binary sentiment classification (positive/negative) based on a Naive Bayes classificator and a SVM. To select top k features I use the MRMR algorithm. The model is trained using a ...
0
votes
3answers
294 views

Classifier feature importance

If I train a GNB/LDA/kNN/other classifier I would like to know, in the model built, how important are features to classify or which feature(s) drives the classifier. For example in SVM models the ...