0
votes
0answers
5 views

Unreliable and uncertainty of RF prediction results (multiple runs) for my data set

Currently, I meet such questions when building Random Forest model using my data set. My full data set: X_lab: 839 * 469 and y_lab: 839 * 1 which is for all labelled data and X_unl: 20346 * 469 which ...
0
votes
0answers
27 views

Visualize a large binary matrix with instances and three classes

I have a matrix with 9500 columns and 1000 rows. Each row represents an instance. I have three classes and an instance belongs to a class. Each column represents a binary feature. That is, each cell ...
0
votes
0answers
11 views

algorithm to predict cost function

The goal of problem is to predict the weight for missing data . I have a dataset of categorical type as shown below ...
0
votes
1answer
34 views

Different results from several “passes” of Random Forest on same dataset

I've been playing around with the German Credit dataset available in Kuhn & Johnson's caret package for ...
2
votes
0answers
20 views

R programming, correlation of quantitave variables with one qualitative variable

I have a flat CSV file that has one column of student names, one column of grades (outcomes) coded as a factor A-F, and about 100 columns of test scores (independent variables) of various sorts, on ...
1
vote
0answers
17 views

Using standard machine learning tools on left-censored data

I'm developing a forecasting application whose purpose is to allow an importer to forecast demand for its products from its customer network of distributors. Sales figures are a pretty good proxy for ...
2
votes
0answers
39 views

How to predict the winner in a set?

At the moment I am dealing with some kind of supervised regression problem, which differs from the stuff I have found on the internet. So here's what the data looks like. (I am working with R) I ...
3
votes
4answers
75 views

Sample selection algorithms to ensure that training & validation sets are representative

Currently, I am encountering a question, which is how to selection representative samples (training set and test set, even validation set) from the whole data set? I would like build a classification ...
0
votes
1answer
56 views

Generating PMML export of a gbm model in R?

Is it possible to generate PMML of a gbm model? When I try to use the pmml library, I get an error: Error in UseMethod("pmml") : no applicable method for 'pmml' applied to an object of class ...
0
votes
1answer
26 views

Does the randome forest for regression solution are interpretable and sparse?

I have regression problem scenario. basically I want to model a certian biological problem as regression models and the end my model should be interpretable. I need to have sparse model. so I'm ...
0
votes
0answers
31 views

Difference between tuneRF {randomForest} OOB error and Model OOB error

I have used tuneRF {randomForest} function to know best mtry and got OOB error is almost 19%, however when i run the model using randomForest am gettin OOB error 28%. I am running the model on same ...
0
votes
0answers
36 views

predicting time series with support vector machine using R

I am planning to do time series prediction using support vector Machine. I could not find any materials about time series application of support vector machines using R or Mat-lab. Similar question ...
0
votes
1answer
37 views

In a neural network of n features which predict a continuous variable X, how to tell the feature which contributes the most to the output value X?

Say I have a neural network which uses some input features say N, some inut layers say L which predict a continous variable say X. Can we say which features or combination of 2 features of the initial ...
2
votes
1answer
23 views

Overfitting with low test error

I have an ensemble of models that yields overfitting by some models by looking at the differentce between training and test error and also overfits in the combined ensemble of models providing a very ...
0
votes
1answer
55 views

Machine learning - curve categorisation

I have curves of the following structure (it is the blue one I am interested in) These curves reflect the volume of blood (actually gamma ray counts) in the left ventricle as a function of time ...
3
votes
3answers
125 views

Optimal classification model for translating words

I have the following problem: I have a set of English words which I want to translate to Dutch. Of each words I mined a set of possible translations. For example, for the word "Eighteen" I obtained ...
1
vote
1answer
46 views

Algorithm to find subsets with high correlation

I have a reasonably large dataset (d) with predictor variables x1...xn and a target variable y. I can use recursive partitioning (such as CART or rpart in R) to find subsets of d with a high (or low) ...
0
votes
1answer
21 views

How to improve the performance of K-nn algorithm in R?

I am having a digit recognizer data set which has column names as label, pixel0, pixel1...pixel783. pixel values vary from 0 to 255 indicating the lightness or darkness of that pixel, with higher ...
0
votes
0answers
14 views

cross validation for kmodes in r

I am using k-modes (link) from the KlaR library (link) to cluster text data. I am not sure how to determine predictive error and thus perform cross-validation. Here is the "toy" sample, lets use ...
1
vote
2answers
33 views

Newbie: Decision Tree in R with Two classes(Yes/No) where one class (No) is much larger than other class (Yes)

I am trying to make a decision tree using 4 features (A,B,C,D) to predict an out come for two classes E(Yes, NO). The problem is that the number of observations in my dataset that belong to one class ...
0
votes
0answers
18 views

Creating obligatory combinations of variables for drawing by random forest

Problem For my machine learning task, I create a set of predictors. Predictors come in "bundles" - multi-dimensional measurements (3 or 4 - dimensional in my case). The hole "bundle" makes sense ...
1
vote
1answer
52 views

What does correlated data mean and how can I visualize it with scatterplot?

I'm playing around with the Abalone dataset in R and following along with this article. The dataset has 8 variables that are taken into account to predict the number of ...
4
votes
4answers
184 views

Predicting time to finish

Out of curiosity, I want to understand how to model this problem. I've been hearing people suggest the use of linear regression but I am not sure how to encode this problem (included my attempt below) ...
0
votes
0answers
35 views

Sample Weights for classification using Gradient-Boosted trees?

How can "weights" be given to different samples according to their relative importance while using Gradient boosted decision trees for classification? How does the ...
0
votes
0answers
22 views

Interpreting R results, are the data multivariate normal?

I ran "mvn" using the "mclust" package in R using the following codes: mvn("EEE", data[,18:22], prior = NULL, warn= NULL) I am having trouble figuring out how to ...
1
vote
0answers
44 views

Has anyone publicly shared an implementation of RUSBoost in R?

There's no package available on CRAN, so I was hoping someone in the community had written their own function/package. I see it's been done in MATLAB, so I may just have to start with that and write ...
0
votes
1answer
50 views

Multi-class Confusion Matrix to Binary confusion matrix

i know the main concepts of data/text mining but i used them mainly in binary classification problems (just two classes). i am now dealing with a problem with 8 classes and i am atruggling how to ...
0
votes
1answer
62 views

How to determine which variable or combination of the variables are affecting to the predictor variable?

I have one dependent variable name as "win ration" of the deal contested and more than 30 independent variables, all are categorical variable name as role of the customer, geo, region, and 27 ...
3
votes
2answers
151 views

Reproduce linear discriminant analysis projection plot

I'm struggling with projection points in linear discriminant analysis (LDA). Many books on multivariate statistical methods illustrate the idea of the LDA with the figure below. The problem ...
0
votes
0answers
76 views

Obtaining sequence of lambda values for training glmnet model via `caret`

I have multiple models that I'm training using train in the caret package, all while using the same cross validation folds to ...
1
vote
0answers
45 views

How to give an input when you are using Machine Learning method in R

I am new to R and machine learning algorithms. I have basic knowledge of different machine learning algorithms. I have four years of daily sales data.I am trying to predict sales using Support Vector ...
2
votes
1answer
73 views

Differences in AUC calculation between pROC and ROCR

Does anyone know the difference in calculation between these two AUC packages? They get different results when I add in positives with predicted value of 0 (simulating a prob model where many outputs ...
6
votes
2answers
166 views

Clustering a noisy data or with outliers

I have a noisy data of two variables like this. ...
0
votes
1answer
57 views

kernels and similarity (in R)

I am trying fit different kernels to calculate similarity matrix in R. Here is example data - X matrix : ...
13
votes
2answers
180 views

Bayesian lasso vs ordinary lasso

Different implementation software are available for lasso. I know a lot discussed about bayesian approach vs frequentist approach in different forums. My question is very specific to lasso - What are ...
0
votes
0answers
17 views

A framework for comparing the performance of Expectation Maximization

I have my own implementation of the Expectation Maximization (EM) algorithm based on the following paper http://pdf.aminer.org/000/221/588/fuzzy_k_means_clustering_with_crisp_regions.pdf I would like ...
0
votes
0answers
25 views

Method to select meaningful features for nearest neighbor classification

i try to perform some k nearest neighbor classification in R. That for i want to select the most meaningful features to deal with the curse of dimensionality. I have already decided to use Mahalanobis ...
0
votes
0answers
26 views

After applying SVD, how do I find which features from my original dataset were most significant?

I'm using MathNet.Numerics library in C# to find the SVD but the Sigma matrix gives no indication of which values correspond to which features. It simply lists them in the most significant order. ...
1
vote
1answer
122 views

Analysis of Customer satisfaction surveys

I have customer feedback data about 2-3 products from 100 customers. Number of questions are around 160. I have data in excel format. Header row contains the question and row below contains the ...
0
votes
0answers
27 views

Predict feature combination with highest probability

I trained a Support Vector Machine with the caret package in R. My dataset looks the following: ...
2
votes
2answers
470 views

Estimate ARMA coefficients through ACF and PACF inspection

I know that this is probably a question that's been asked plenty of times, but i haven't seen an answer that's both accurate and simple. How do you estimate the appropriate forecast model for a time ...
1
vote
0answers
15 views

determing states in HMM with BIC

I'm fitting a HMM to time series, for each data set I use BIC results to select the optimum number of states. In that, the BIC number is lowest and thereby indicating this model with that number of ...
0
votes
1answer
99 views

Way to train Hidden Markov Model in R with multiple sequences

i have multiple sequences for each of two states. I'd like to train a HMM with these to predict the state for unkown sequences. Here is an example for this problem: ...
2
votes
0answers
48 views

Predicting the Success of a tweet

I want to predict the success of a tweet. In my case a tweet is successful when the sum of the number of favorites and the number of retweets is greater than 5. So my outcome value y is: y= ...
0
votes
0answers
72 views

Decision tree in R

I am new to machine learning in R. This is my data set. ...
1
vote
1answer
63 views

What does the parameter $\alpha$ do in the Jaccard method for binaryRatingsMatrix in R recommenderlab?

What is the role of the parameter 'alpha' in the recommenderlab R package's use of Jaccard method in the recommender model for ...
0
votes
2answers
128 views

Best feature selection method for naive Bayes classification

i want to make classification with naive Bayes. I have got about 100 Features. Numerical ones as well as categorical ones. Since i want only the most relevant ones to be included for the ...
0
votes
1answer
84 views

Question about normalize/scale data before using neuralnet

I have read several threads about the issue on same outputs after people fitting a neural network model with R neuralnet. Posted Solution is to normalize or scale the data before fitting model. Since ...
0
votes
0answers
71 views

Combining CostSensitiveClassifer with MultiClassClassifier [RWeka]

this is my first attempt at posting here. I looked through CrossValidated and found two similar problems without answers (see How to combine WEKA classifiers and Combine MultiClassClassifier and ...
0
votes
1answer
110 views

Machine-Learning algorithms for Forecasting

For work, I'm working on an app where you essentially forecast the failure rate of the overall machine through different factors such as the historical failure rates for the components used to build ...