0
votes
0answers
15 views

test validation versus k-fold cross validation

I am attempting to use a neural network, after using other machine learning algorithms. I am using the RSNNS package (I am willing to use / evaluate other packages) that's part of R. I would like to ...
0
votes
0answers
6 views

Maxent Markov models in R

Is there a package that implements Maxent Markov Models in R? (http://en.wikipedia.org/wiki/Maximum-entropy_Markov_model). I understand that package crf implemets conditional random fields which are ...
0
votes
0answers
45 views

Multicollinearity classification regression with R [closed]

I want to do multiple regression, but my explanatory variables are highly correlated with each other. Some are roughly a linear combination of others. To deal with that, I tried to analyse my data ...
-1
votes
0answers
22 views

synthetic replication of a fund using a classification of the univers and a recursive regression [closed]

i m working on a replication of a specific fund i have daily data of this fund, and 20 index to replicate this fund what i aim to is giving this data i want to know what is the starategy of the 5 ...
0
votes
0answers
14 views

visualize the naive bayes with k-fold cv

I have done the classification using naive Bayes as a classifier, and applied 10-fold CV.I know that I can get the mean and variance of the result. However, how can I plot the classifier performance? ...
0
votes
1answer
36 views

Way to train Hidden Markov Model in R with multiple sequences

i have multiple sequences for each of two states. I'd like to train a HMM with these to predict the state for unkown sequences. Here is an example for this problem: ...
-2
votes
0answers
22 views

analyzing neturalnet function from R [duplicate]

'neuralnet' package in R allows us to use neural network algorithm with back propagation. I want to use the function for prediction. I saw a tutorial on neuralnet in which iris data was predicted. I ...
0
votes
2answers
43 views

Best feature selection method for naive Bayes classification

i want to make classification with naive Bayes. I have got about 100 Features. Numerical ones as well as categorical ones. Since i want only the most relevant ones to be included for the ...
1
vote
0answers
15 views

construct/load dataset that performs better with diffusion kernel than other kernel

I'm looking for a dataset on which a diffusion kernel (also called heat kernel), used via SVM, would get better accuracy than other kernels for the classification task. I want to use such a dataset to ...
1
vote
0answers
33 views

Hierarchiqual prediction using R

I'm pretty new in R, and I couldn't find any information about a package who can do the following: supposing that I have a set of data (for instance, different text documents), which can have several ...
0
votes
0answers
29 views

Multivariate Multiple Classification

Is it possible to have multiple (at least 3) dependent variables in a single classification model. I know this can be accomplished in a regression model but I need to perform this with a ...
2
votes
2answers
104 views

Evaluating accuracy of binary logistic regression on skewed data

I've been having an argument with a friend of mine, and it's very possible I'm wrong here. We are performing binary logistic regression on a dataset with 10000 observations, classifying action as ...
0
votes
1answer
27 views

Some Basic things we need to do when we are doing text classification

I am working on a project where I have to do multi-label text classification. I want to understand that whether my approach is correct or I am missing something. I am using R to do it. Clean ...
1
vote
1answer
90 views

I want to learn about ROC curve — what is the canonical textbook?

I want to learn about Receiver-Operator-Characteristic curves, and metrics. I have read through online webpages with some basics, and I have used MATLAB built-ins to create ROC plots. It tells me ...
0
votes
0answers
33 views

how to compute odds ratio

Given a generic classification model $y=f(x_1,x_2,..,x_p)$ where $y\in \left\lbrace 0,1 \right\rbrace$ is it possible to compute the odds ratio for each variable? A theoretical explanation and ...
2
votes
1answer
132 views

How to implement a hold-out validation in R

Let's say I'm using the Sonar data and I'd like to make a hold-out validation in R. I partitioned the data using the createFolds ...
2
votes
1answer
191 views

Relative importance of a set of predictors in a random forests classification in R

I'd like to determine the relative importance of sets of variables toward a randomForest classification model in R. The ...
1
vote
0answers
46 views

R package kernlab probabilities seem not to match decision

For a classification problem I am giving the R package kernlab a shot – not the least because it offers to calculate class probabilities instead of only a plain decision. However, comparing results ...
0
votes
0answers
97 views

Pattern Recognition in Practical Problem in R

I am using R for last 4 months with basic test analysis, regression models, ANOVA etc. Now I am looking into a particular problem. In words problem can be stated like, A particular machine got a ...
4
votes
2answers
111 views

What's the easiest way to separate two populations in a scatterplot?

I have to separate two populations by a line in a scatterplot: I would like find a threshold that separates the two populations. In @Waynes words, I would like to cluster the points into two ...
0
votes
0answers
40 views

Which diffusion of latent Dirichlet allocation is helpful for assign the words corresponds to each topic?

In my corpus documents I have two different subjects. Which diffusion of LDA (asymmetric or symmetric) could help for assigning the words corresponds to Subject 1 and Subject 2 in my Topics? Here is ...
1
vote
1answer
51 views

Divergence measure of two classifiers' performance?

I have two classifiers built with the same data. How can I measure divergence of these models? I found something like DIC but I don't know how to calculate this in R?
1
vote
1answer
566 views

Accuracy rate in naive Bayes classification

I am trying to use a naive Bayes classification technique to predict fraudsters (Caller). My training set of 138 instances has 5 columns viz. ...
1
vote
0answers
55 views

Classifier predicts only one class

I was trying myself in kaggle CIFAR competition, I trained lots of classifiers but get the same result/fail (don't know how to treat them), maybe someone could help me figure what i'm doing wrong. ...
0
votes
0answers
23 views

Classification model that allows changing priors at prediction time

I would like to know if there's a way to build a classification model in R that would allow me to change the class weights at prediction time. The scenario where I would want to do this: I have a ...
3
votes
1answer
435 views

Understanding the output of C5.0 classification model using the CARET package

The C5.0 classification model was used in this 4-class problem data with $N_{train}$=165, $P$=11, using caret R-package by ...
1
vote
1answer
129 views

Image classification using histogram

My apologies for another stats beginner question. This feels like reinventing the wheel, unfortunately I just can't find the answer myself. Googling "average densities classification" does not help ...
2
votes
1answer
178 views

How to interpret this cross-validated sparse LDA figure using CARET package?

Training data with $p$ =11 predictors and $n$ =165 with 4-class problem was cross-validated (5 times repeated 10-fold CV) using the sparse LDA (aka SDA) using caret ...
1
vote
2answers
121 views

Weighting more recent data in Random Forest model

I'm training a classification model with Random Forest to discriminate between 6 categories. My transactional data has approximately 60k+ observations and 35 variables. Here's an example of how it ...
0
votes
0answers
54 views

multiple time series classification using randomForest R

I have daily time series of all constituent stocks/members of the S&P500, over a 5 yr horizon, and wish to classify as to whether a stock will report an "earnings revision" via a binary outcome ...
0
votes
1answer
54 views

Using regression forest for a factor variable

I want to predict if a customer is interested in a new product and I use the randomForest package for that. Target variable : factor (Yes or No) so I use the randomForest for classification : ...
1
vote
1answer
435 views

What is the best strategy to train and validate classification using PLS-[classifier] in caret package?

I have 4 clusters (see plot below) extracted from data of medical samples N=218 measured for 11 genes/predictors P=11 by this ...
0
votes
0answers
35 views

Representing a class by negative number for training in GBM in R

I have already generated a huge train file of ~1GB in which the ground truth is one of 4 classes {-1,0,1,2}. Yes, I agree that I could have done it using 3 instead of -1, but for some conventional ...
1
vote
1answer
41 views

Estimate duration using categorical data

I have a dataset of tasks. Each task: has a duration (difftime in seconds) belongs to a project (project name factor) has an owner (user name factor) In R , I can simulate my data by something ...
4
votes
1answer
320 views

Can Random Forests do much better than the 2.8% test error on MNIST?

I haven't found any literature on the application of Random Forests to MNIST, CIFAR, STL-10, etc. so I thought I'd try them with the permutation-invariant MNIST myself. In R, I tried: ...
4
votes
1answer
158 views

2D binary classification

Background A laboratory wants to evaluate whether a certain form of gel electrophoresis is suited as a classification method for the quality of a certain substance. Several gels were loaded, each ...
0
votes
1answer
306 views

random forest classification in R - no separation in training set

Originally posted on Stack Overflow, but suggested to move here... I'm new to machine learning, but I've tried to perform a Random Forest classification (randomForest package in R) on some ...
3
votes
3answers
686 views

Logistic regression: maximizing true positives - false positives

I have a logistic regression model (fit via glmnet in R with elastic net regularization), and I would like to maximize the difference between true positives and false positives. In order to do this, ...
0
votes
0answers
41 views

Minimizing Specificity in Adaboost (and other) Classifiers

This is a relatively simple question, but is not addressed in the documentation for the ada package in R. How do I go about instructing ...
1
vote
1answer
122 views

How bagging on CART (RPART) is different from CART with cross validation?

I am wondering is there any difference between the following two algorithms: RPART (Recursive partitioning) in R, with cross-validation (xval = 10, default) Bagging on RPART In the first case, ...
3
votes
1answer
126 views

How to draw ROC curve with three response variable?

I have a toy example reproduced below in which the response variable has three possible classes. I am trying to create an ROC but not sure how to deal with it when there are three classes. Any help ...
0
votes
0answers
49 views

Classification with Bayes Network (deal)

I am working with multiple binary vectors e.g., A,B,C,D,E,F,G,H. I want to find the classification between them. I have tried the following: ...
0
votes
0answers
81 views

What to expect from classification models

I am testing various classification schemes on a training set with about 3000 instances and 20 attributes. The train set is distributed into 6 classes such that the chance accuracy would be about 18%. ...
0
votes
1answer
78 views

Priors and Loss in R

I am fairly new to R and data mining concepts and am trying to understand the rpart package in R. I am a bit confused about the role of priors and loss in the ...
1
vote
1answer
132 views

Binary classification on imbalance data with missing values and almost equal dimensions?

I have a data set with following qualities: Attributes: 500 Instances: 1500 Class Ratio: 1:15 Missing Values: Yes ~5% How should I perform classification on ...
1
vote
0answers
30 views

Group Classification for uni-variate Data R

Given that I have some data for prices, and i have several prices groups, say, Data = [$15,$20,$20,$10,$15,$25,$20,$15] and Groups: ...
2
votes
1answer
243 views

SMOTE throws error for multi class imbalance problem

I am trying to use SMOTE to correct imbalance in my multi-class classification problem. Although SMOTE works perfectly on the iris dataset as per the SMOTE help document, it does not work on a similar ...
-1
votes
1answer
90 views

Classifying data in R [closed]

I'm using R and I want to use some type of machine learning technique (SVM, perhaps) to classify data. I have data that looks like this, for example ...
2
votes
0answers
79 views

What form of analysis should be used for loss given default estimates?

I am working on BASEL II IRB models and we have to estimate loss based on historic defaults. There are different outcomes/scenarios we have identified that a default can encounter that will affect ...
1
vote
2answers
151 views

Imputation of missing parameter value by regressing the other parameters

I have a question on imputation of missing values. A support vector machine does not work with missing values, and in practice i thus hence na.omit the rows / cases with missing values on any of the ...