Methods and principles of building "computer systems that automatically improve with experience."

learn more… | top users | synonyms

0
votes
0answers
8 views

Asking tweet classification

I want to ask you the process to classify the tweet data. Now, I am working to Twitter data but i have confuse how to classify the tweet data using Mallet Tool. Example; I have 200,000 tweets. The ...
0
votes
0answers
9 views

Sample Weights for classification using Gradient-Boosted trees?

How can "weights" be given to different samples according to their relative importance while using Gradient boosted decision trees for classification? How does the ...
0
votes
0answers
10 views

Feature boosting via rescaling in logistic regression and linear SVMs

If I were expressing a problem in terms of binary features, all encoded as {0,1}, could I boost some features by encoding them as {0,2}? Would the effect change based on whether I used either of the ...
0
votes
1answer
20 views

How to choose the training, cross-validation, and test set sizes for small sample-size data?

Assume I have a small sample size, e.g. N=100, and two classes. How should I choose the training, cross-validation, and test set sizes for machine learning? I would intuitively pick Training set ...
0
votes
0answers
7 views

computing EP messages in factor graph

I'm using infer.net for implementing a dynamic Bayesian network model. every node in each layer is dependent on all nodes in previous layer (we want to train wji, the weights of edges between each ...
0
votes
1answer
15 views

what are the alternative open source tools for PredictionIO?

PredictionIO is good to be enough for content discovery and recommendation but it seems it does not support classification. Then I should use a different tool then Prediction IO for my prediction ...
1
vote
1answer
42 views

Linear regression of 0/1 response (Fig. 2.1 of The elements of statistical learning)

In chapter 2 ESL book authors write: Let's look at example of linear model in a classification context They fit a simple linear model $g = 0.3290614 -0.0226360\cdot x_1 + 0.2495983 \cdot x_2 + e$, ...
1
vote
2answers
24 views

How to compare two clusterings generated by two clustering approaches

I am currently working on a modification of a clustering algorithm to suit my problem domain. I want to know which methods are available for me to compare the centroids generated from the two ...
0
votes
0answers
12 views

The ethics of using an optimal multiclass feature set for binary classification

I'm currently trying to find the best feature set/network architecture configuration for a binary classification problem, however to approach it via the usual means of building and testing does not ...
0
votes
0answers
10 views

Is time-delay embedding/attractor reconstruction used in some machine learning algorithm?

I try to model/forecast blood glucose levels from my diabetes diary, so I have to deal with some 5-7 daily measurements of estimated carbohydrates, physical activity, insulin doses and measured blood ...
0
votes
0answers
14 views

Interpreting R results, are the data multivariate normal?

I ran "mvn" using the "mclust" package in R using the following codes: mvn("EEE", data[,18:22], prior = NULL, warn= NULL) I am having trouble figuring out how to ...
0
votes
3answers
49 views

How to Use Neural Networks to Forecast Time Series Data with Predictor Variables?

I have browsed a lot of topics here, but the ones I see were all about forecasting a single variable, depending on its historical values. Whereas I want to predict a variable, by estimating a ...
0
votes
0answers
20 views

Is it true that decision trees can handle dependent features very well?

I have once heard that decision trees can handle dependent features very well, compared to e.g. Naive Bayes classifiers. However, I can't find any scientific source for that. So my question: is it ...
1
vote
1answer
37 views

Machine learning with categorical data: Can I delete examples?

I have a machine learning project that uses a bunch of features to predict a class that has categorical values. The possible values are: 1, 2, 3, 4, and 5. I'm interested whether the class has the ...
0
votes
0answers
9 views

Which terms are more standard: precision and recall or correctness and completeness?

I am familiar with terms like precision rate and recall rate from the machine learning literature, but recently I was reviewing a thesis which used the terms correctness and completeness. A quick ...
0
votes
0answers
19 views

Calculate rating/score based on multiple criteria to rank data

I extract data related to a movie by sentiment analyzing the reviews. Hence,extracted movie data contains average sentiment values (avg_pos and avg_neg) calculated over multiple reviews, total no of ...
0
votes
0answers
13 views

Stacked Generalization Ensemble Algorithm for regression

I am using stacked generalization(Rupert 1992) for combining multiple(8) heterogeneous base learners for regression. What I understand from the pseudo codes that Train the 8 learners on 8 instances ...
1
vote
0answers
14 views

Comparing densities of a feature for different classes when the feature is irrelevant to one class

Let us suppose that I have a number of features. I design pdfs for every feature and every class, some of them by smoothing some histogram of training samples, others just by introducing the prior ...
1
vote
1answer
28 views

Evaluating performance of machine learning models

I'm trying to predict when a location has enough wind to go sailing. I've built several models that look for correlations between different weather conditions and whether it ends up being windy X ...
0
votes
1answer
16 views

Instance weighing in libsvm/liblinear

I often use the instance weights with Libsvm for classification problems. http://www.csie.ntu.edu.tw/~cjlin/libsvmtools/#weights_for_data_instances Does anyone know the details of the algorithm that ...
0
votes
1answer
32 views

How can I evaluate my model when the the testing data are too few and the generated results don't match testing data

I have a bioinformatic data set includes a very large negative examples (let's say 30000 examples) and just a few positive examples (let's say 150 positive examples). Since I need to feed an enough ...
1
vote
0answers
28 views

Has anyone publicly shared an implementation of RUSBoost in R?

There's no package available on CRAN, so I was hoping someone in the community had written their own function/package. I see it's been done in MATLAB, so I may just have to start with that and write ...
0
votes
1answer
32 views

R codes for variation of information criterion using “mclust”

I am developing model-based clustering. First, I developed model-based clustering in R using "mclust." Next, I wanted to take 75% of the sample, re-run model-based clustering and compare the ...
0
votes
2answers
27 views

The role of the bias terms in matrix factorization formulas?

I'm reading about matrix factorization for recommender systems. A basic matrix factorization model would be something like: $(p_i \times q_j ) + b_i + b_j$. That formula would compute the rating for ...
0
votes
0answers
10 views

Multi-class logarithmic loss function per class

In a multi-classification problem, we define the logarithmic loss function $F$ in terms of the logarithmic loss function per label $F_i$ as: $$ F = -\frac{1}{N}\sum_{i}^{N}\sum_{j}^{M}y_{ij} \cdot ...
0
votes
0answers
12 views

How to handle large .csv file in R? [migrated]

I have a large(>100,000) single column floating point time-series data. I want to find structural changes within the data with respect to time( in my case index). In-order to do that, I am using R ...
1
vote
0answers
32 views

SVM versus Bayesian regression example(s)?

I am trying to track down examples where some basic problems have been tackled via both classical Machine Learning algorithms and more formal statistical methods. In particular, I'm interested in ...
0
votes
1answer
47 views

How would a decision tree algorithm apply to the Mushroom dataset [closed]

I'm looking for dataset to explore that would give me an opportunity to understand the pros and cons various ML algorithms; such as decision trees, nearest neighbor, SVM, and neural. I'm going ...
0
votes
0answers
78 views

Is my learnings in Machine Learning fine? [closed]

I am a self learner in Machine Learning. I am from humanities background. My goal was to know bit of Machine Learning and to develop few applications based on few algorithms. To get feel of the ...
-1
votes
0answers
42 views

Sales Forecasting using Support Vector Machine

I have sales data for last three years 2011-2013. I want to use Support Vector Machine technique in R to do the predictions. I just wanted to know that the approach that I am using is correct or not? ...
0
votes
0answers
24 views

Hidden Markov Models relationship

I have a question regarding a small investigation that I have been conducting into the relationship between the length of observation sequence, T, on which two decoders (BCJR and classic Viterbi) ...
0
votes
0answers
42 views

The best way to solve particular classification problem?

I got training set (time series) of size approximately 2 million precedents {x,y}. Each x is a vector of size 20 and each y is a binary vector of size 10 like {1,0,0,1,1,0,1,1,1,0}. For a new input x ...
1
vote
0answers
17 views

How do you deal with different distance based features?

If I have a model where the set of features where a cosign distance measure makes sense for some of the features, and a Euclidean distance measure makes sense for the others for example using a BOW ...
0
votes
0answers
7 views

Hyper-parameters for pretrain and fine-tuning

When doing deep learning, in particular dnn, it's shown that pre-train each layer in a unsupervised fashion, then fine-tune the weights using the labeled data in a supervised fashion. My problem is, ...
0
votes
0answers
16 views

Examine SVM result by plotting histogram of decision values of training samples

I'm working for object detection(computer vision) and have some problems in SVM training. My training configuration is as below. Balanced training set (positive 3998/ negative 3998) The dimension of ...
0
votes
0answers
18 views

Choosing fold size for highly Imbalanced dataset + nested CV + svm

I am trying to classify a dataset with ~1000 points. 90/10 is the class ratio - super imbalanced. Here are the following steps I did: Use 20 relevant features from previous knowledge Remove highly ...
1
vote
3answers
114 views

What are the most popular artificial neural network algorithms for recognising the content of images?

What are the most used/popular artificial neural network algorithms for recognising the content of images in general? E.g. If the picture is of a person, dog, cat or a car. If the picture is a ...
0
votes
1answer
23 views

Whats going wrong in Implementation of this gaussian bernoulli RBM?

I have a problem in finding negdata value. In particular multiplying with sigma. Could someone help in representing this equation vishid*sigma*poshidstates + visbias in matlab. ...
0
votes
1answer
53 views

Classification using correlation

Given two correlation matrix (each $p \times p$), where each belongs to a different group, is it possible to classify a new sample into one of the group (based on the correlation matrix only)? What ...
1
vote
2answers
60 views

How does random Forest work for regression?

I am an absolute beginner in field of machine learning, I started doing titanic assignment in Kaggle and found(read some where) Random Forest is the best fit. I started reading about random forest and ...
0
votes
1answer
60 views

High Standard Deviation for Leave one out cross-validation?

I am using the leave one out cross-validation technique to evaluate my model. If the prediction on the test sample is right the output is 1 otherwise 0. So I have a array of N samples with 0's and 1's ...
0
votes
0answers
26 views

different feature types for classification

There has a data set with several features. One feature is of the type of continuous numerical values; another feature is of the type of categorical values, such as A, B and C. If I want to build a ...
0
votes
1answer
21 views

Is my understanding of how to calculate the reachability distance in local outlier factor correct?

Reading lof implementation at : http://www.cse.ust.hk/~leichen/courses/msc-it5210/lectures/LOF_Example.pdf the local reachability distance is given as : I don't fully understand this equation as ...
0
votes
1answer
16 views

How to use a set attributes of an entity at different time snaps to make predictive analysis?

The problem is to come up with a classifier for any task based on a set of attributes of an entity having different values at different times. For instance think about football players and their match ...
1
vote
0answers
13 views

Applying autoencoders for dimensionality reduction in audio: Why does this create a low-pass effect? [closed]

I've been playing around with framing audio data and training a single-layer autoencoder to find a dimensionality-reduced form (say 128-sample frames to 32-dimension frames). When I test the audio ...
0
votes
2answers
155 views

When to avoid Random Forest?

Random forests are well known to perform fairly well on a variety of tasks and have been referred to as the leatherman of learning methods. Are there any types of problems or specific conditions in ...
1
vote
1answer
43 views

Post hoc selection of important features in random forest?

I want to guarantee a parsimonious random forest (few features used). What are methods to do this? It was suggested to me to get the feature importance after the model was created, and then create a ...
0
votes
0answers
28 views

Validation accuracy larger than training accuracy

I was performing an experiment but got a higher validation accuracy than training accuracy. I've got a 39 mice data and performed leave one out cross-validation. The validation accuracy was 100%. But ...
2
votes
2answers
31 views

Accuracy of random prediction with non equal distribution

Assume that I want to predict the value of a variable that has three different states: a, b, and c. The chance that these variables have the 3 states is not equally distributed. Out of 10 trials, the ...
2
votes
2answers
54 views

Which property of count data make mean-variance dependency?

I have read about the fact that, there is dependency of variance on mean of count data.In most of cases they do variance stabilization transfomration as preprocessing step of data modeling. I wonder, ...