Methods and principles of building "computer systems that automatically improve with experience."

learn more… | top users | synonyms (1)

0
votes
1answer
8 views

Unconnected Linearly Seperable Classification

Consider classifying something like the case shown below (exagerated syntetic example): If this were a task to classsify into 3 groups, (blue-left, red, blue-right), then a Linear Support Vector ...
0
votes
0answers
3 views

Structural Correspondence Learning for Domain Adaptation - how is the augmented data formed?

Structural Correspondence Learning (SCL) is a method for dealing with domain adaptation (different data distributions in the training and testing sets). It was proposed by Blitzer et al. but I am ...
0
votes
0answers
15 views

Are fixed bias neurons or biased neurons better?

When building an artificial neural network, there seems to be two differing philosophies in usage of biases. There are those groups that propose neural networks with a fixed bias neuron with a ...
0
votes
0answers
9 views

Softmax Regression GD Update Derivation

I'm implementing softmax regression and am deriving the max-log-likelihood update for gradient descent by hand first. Coming from the Stanford UFLDL site, they show the gradient of the cost function ...
0
votes
1answer
15 views

how to interpret metrics for my model

I understand how these metrics are determined but can anyone give me typical poor, acceptable, good, and outstanding values RAE and RSE?
0
votes
1answer
24 views

How to do one-vs-one classification for logistic regression?

I have a dataset with 4 clases and I want to apply logistic regression with one-vs-one classification. So, first I train for each pair of classes a logistic regression classifier (i.e. calculate the ...
0
votes
1answer
29 views

Adaboost for numeric dataset

I have been trying to fit Adaboost to work with continuous valued data set and the more I read the more I keep getting confused. I have read about the multiclass Adaboost with log(K-1) addition to ...
0
votes
0answers
15 views

How can you detect outliers in a group of face images?

I'm trying to filter an image database which contains some irrelevant pictures. All the faces are labeled with points around the face contour, eyes, mouth, eyebrows, have age and gender. The faces are ...
0
votes
0answers
9 views

Training and Activating a 2 layer deep network

I've been working with synaptic.js to make neural-networks in the browser for a while and I've decided I want to implemented deep-learning for a project I'm working on ( connecting an lstm to a ...
0
votes
0answers
11 views

what exactly is projected gradient descent?

I am reading the article with title "metric learning by collapsing classes" http://papers.nips.cc/paper/2947-metric-learning-by-collapsing-classes.pdf.There are some questions which has bothered me ...
3
votes
0answers
11 views

What are the differences between Ridge regression using R's glmnet and Python's scikit-learn?

I am going through the LAB section §6.6 on Ridge Regression/Lasso in the book 'An Introduction to Statistical Learning with Applications in R' by James, Witten, Hastie, Tibshirani (2013). More ...
1
vote
1answer
19 views

Data splitting using kennard stone [on hold]

I would like to use kennard stone algorithm for splitting a dataset into training and test set. Does Weka /Rapidminer/any free software with GUI has a feature to do this? If so, would like to know the ...
1
vote
1answer
33 views

Why is the energy and the probability of a configuration related in a Boltzmann machine?

According to Hinton's slides (slide 34) the following relationship holds for Boltzmann Machines in thermal equilibrium: $$ p(v,h) = \frac{e^{-E(v,h)}}{\sum_{u,g}{e^{-E(u,g)}}} $$ To me this is not ...
0
votes
0answers
33 views

How is bootstrapping used for machine learning?

How does one use bootstrapping in a machine learning context? My typical data analysis pipeline is Split data into 10 folds Train classifier with 9 folds Test classifier with remaining fold Repeat ...
0
votes
0answers
22 views

Get important features of n samples

Suppose I have a data frame of [n_samples, m_features] with the corresponding variances of the features [n_features]. The values in my data is between 0 and 1 so the question is: Is there any way to ...
0
votes
0answers
21 views

How can I make Weka classify the smaller class, with a 2:1 class imbalance?

How can I make Weka classify the smaller classification? I have a data set where the positive classification is 35% of the data set and the negative classification is 65% of the data set. I want Weka ...
0
votes
0answers
18 views

Time-series cross-sectional classification problem

I have a time-series cross-sectional dataset consisting of 100 individuals that each had 4 features measured yearly for 21 consecutive years. One of the features is binary and the other three are ...
0
votes
0answers
7 views

How can I use Extreme Learning Machine in Rapidminer? [on hold]

I am working on a problem, I need to use 'Extreme Learning Machine.' But I don't know any programming language. I use Rapidminer. Is it possible to use the algorithm on Rapidminer?
0
votes
0answers
18 views

Representation of misspelled words for neural network?

While thinking about a neural network based spellchecker, I was thinking about word embedding not being able to represent any "unique" (misspelled) words that the model haven't seen before. I tried ...
1
vote
0answers
9 views

how can fixed parameters cost and gamma using libsvm matlab to improve accuracy? [migrated]

I use libsvm to classify a data base that contain 1000 labels. I am new in libsvm and I found a problem to choose the parameters c and g to improve performance. First, here is the program that I use ...
0
votes
0answers
7 views

Regarding pattern recognition and forecasting next set of sequence [on hold]

I have been working on use case where I have some sample data as below : Date Device Name Time Facility Code 1/6/2015 Tablet X 16:18:48:168 22 A 1/6/2015 Tablet X 16:18:50:41 ...
0
votes
0answers
24 views

Kernel K nearest neighbours with sparse data

I have a big sparse matrix (around 5 million of lines, 20 000 predictors), and I would like to run a kernelized k-NN on it. However, I don't know how to scale the data properly. So far, I have scaled ...
0
votes
1answer
62 views

Improving a logistic regression model in R [on hold]

I have to devise a model in R, capable of predicting the type of a disease, which is a categorical dependent variable (three possible values), through several continuous and categorical, some of the ...
0
votes
0answers
8 views

mahout kmeans class not found exception [closed]

I have configured Hadoop in Psuedo-Distributed mode. I have succesfully created sequence-files and tf-idf vectors(using seq2sparse) and am trying to run mahout kmeans from command-line as follows: ...
0
votes
0answers
14 views

What techniques infer dependencies between time series?

I'm working on an ML project. We have an app where users can track 1) binary variables and 2) quantities over time on a scale from one to ten. For example, at a given time they may track whether they ...
0
votes
0answers
12 views

VC Dimension of the set of canonical hyperplanes

This is a proof of the theorem about VC Dimension of the set of canonical hyperplanes from Professor Mohri's lecture slide. I'm having difficulty with understanding the inequality$$ \forall i \in ...
0
votes
0answers
23 views

Upcoming areas in theoretical Bayesian Machine Learning [closed]

I will soon be going for a postdoc position at a new university. One thing that the panelist asked me to think of is if I were to start, what would I work on. Now the thing is so far with my PhD ...
0
votes
0answers
21 views

Advanced Method in Machine Learning to Learn Objects Position

I have done research about tracking of human body, face, hands, pedestrian etc. Can you point me to the methods in machine learning that learn the changes in position of multiple objects for object ...
0
votes
0answers
7 views

RSNNS neural networks, checking percentage correct.

For those who have some experience with RSNNS, I'm trying to build a neural network for reading aloud, using RSNNS in R. To give some information about what I'm doing and using. I'm using orthographic ...
1
vote
1answer
18 views

Is there a difference between on-line learning, incremental learning and sequential learning?

What I mean is the following: Instead of processing all the training data at once and calculating a model or hypothesis, we process one data point at a time and update the model directly afterwards. ...
0
votes
0answers
7 views

How should I measure difference between user behavior / model performance on different population?

I am developing a recommendation engine whose goal is to suggest data exploration routes to non-technical users. The underlying model is content based, with the training data made up of the behavior ...
0
votes
0answers
16 views

How to use Particle Swarm Optimization for finding optimal bandwidth with cross-validation?

I want to use Particle Swarm Optimization (PSO)for finding optimal smoothing parameters of a kernel density estimation problem. Initially I tried to find the same using grid search method,but the ...
1
vote
0answers
8 views

Touch times to authenticate user

for a project I gathered touch data of different users when they tap a rhythm repeatedly on the touch screen in a game. ...
0
votes
0answers
60 views

how to solve an optimization problem? [closed]

I am reading an article with title "Learning a distance metric from relative comparisions" lately. http://www.cs.cornell.edu/people/tj/publications/schultz_joachims_03a.pdf. The basic idea for this ...
0
votes
0answers
9 views

Scikit Random forest pred_proba gives rounded off values

I am using random forest in scikit learn for classification and for getting the class probabilities , I used pred_proba function. But strangely it outputs probabilities rounded to first decimal place ...
0
votes
2answers
32 views

Name some techniques similar to Random Forests

I'm interested in what techniques are out there that are similar to, but not the same as, Random Forests. Either for classification or regression or both. Particularly interested in techniques which ...
-1
votes
0answers
31 views

SKLearn Clustering: how would you cluster a LARGE database of dogs? [closed]

Given: A VERY large dataset of dogs. columns: ID (alphanumeric) Weight (numeric) Height (numeric) Eye Color (alphabet) ... (numeric) Tongue Length (numeric) How do you find what makes these ...
0
votes
0answers
41 views

Fitting a trading model [closed]

I have a high frequency time series of the bid and ask prices of a stock recorded on every tick. For each data point I also have a certain indicators that predict the future movement of the price. The ...
1
vote
1answer
37 views

Weight shrinking in linear regression by L2 regularization

Quoting Prof. Bengio from his Deep Learning text (http://www.iro.umontreal.ca/~bengioy/dlbook/regularization.html), $ w = (X^{T}X + \alpha I)^{-1}X^{T}y $ We can see L2 regularization causes ...
0
votes
0answers
7 views

Reduce the FP rate for a Random Forest (sklearn)

I am working with the scikit-learn random forest classifier and I want to reduce the FP rate by increasing the number of trees needed for a successful vote from greater than 50% to say 75%, after ...
0
votes
0answers
10 views

How to model the problem of predicting failure in Server Clusters

The problem goes as follows - There is a cluster of Servers. Whenever there is failure/anomaly in any of the server, a report is logged. Some of the features of the log report are Time of Failure ...
0
votes
0answers
10 views

Website classification using metadata features

I want to fit a model that predicts a website type according to metadata features that I manually collected, such as - Average text length, average # of pics, average outgoing links per page, etc... ...
0
votes
0answers
23 views

Getting an error message “Error in if(reached.threshold < min.reached.threshold)…” while training network using neuralnet package

I'm using R to create train and test a neural network on a time series (the annual sales of a company over a large period of time). As using the package's default learning algorithm (resilient ...
12
votes
3answers
510 views

What can we learn about the human brain from artificial neural networks?

I know my question/title is not very specific, so I will try to clearify it: Artificial neural networks have relatively strict designs. Of course, generally, they are influenced by biology and try to ...
1
vote
1answer
76 views

Why is SVM better for bioinformatics analysis?

I have used five different algorithms: bagging, boosting, C4.5, random forests and SVM, for binary classification of biological data relating to peptide sequence. The dataset comprised of ...
1
vote
2answers
42 views

what is the difference between area under roc and weighted area under roc?

Thanks in advance for the help. I have an unbalanced dataset that I am using for a binary classification problem. The classes are unbalanced. I believe that in such a case that weighted area under ...
1
vote
0answers
13 views

how to understand this neighborhood components analysis model?

I am reading an article with title "neighborhood components analysis" lately. http://papers.nips.cc/paper/2566-neighbourhood-components-analysis.pdf. This article is trying to introduce a linear ...
2
votes
1answer
43 views

How to use linear regression for heavily skewed purchase data?

I am trying to use multiple linear regression to predict the amount that a particular user will spend in a particular time frame on a particular site. Part of the problem is that there are very few ...
1
vote
1answer
53 views

In a Boltzmann machine, why isn't there a simple expression for the optimal edge weights in terms of correlations between variables?

Suppose I have a fully connected, fully visible Boltzmann machine (no hidden variables) with binary variables $x_i\in \{+1, -1\}$ that defines the probability distribution $$ p(\mathbf{x} ; ...
0
votes
0answers
13 views

when to stop this convex optimizations algorithm?

I am reading the article with title "metric learning with collaping classes" lately http://papers.nips.cc/paper/2947-metric-learning-by-collapsing-classes.pdf. See this thread (what is 1/0 in this ...