Methods and principles of building "computer systems that automatically improve with experience."

learn more… | top users | synonyms (1)

0
votes
0answers
10 views

Why does epsilon greedy policy improvement works?

A simple, well explained proof will do the work. Thanks.
1
vote
1answer
15 views

Should I use drop connect and L2 regularization?

I've just learned about the drop connect technique for neural networks. It is my understanding that it is intended to reduce over fitting and is referred to as regularization. Is there additional ...
0
votes
1answer
12 views

Classification eda

I am constructing a 2-class classifier and using cross validation to tune certain parameters in my model. The predictor variables are both continuous and one is ordinal. Based on looking at the ...
1
vote
0answers
12 views

Can AdaBoost be used with multiple measurements?

Can Adaboost be used with multiple measurments? If yes, how / why is it working? Example: let's say I want to predict if it's going to rain=1, or not=-1 and I want to model my prediction based on, ...
0
votes
0answers
13 views

Training a neural network on non-image , non-text data

I know this is a newbie question but I really want to know , is it possible to train a Tensorflow neural network on non-image , non-text data (a vector:[Stat1,Stat2,...,StatN] where Stati is a unique ...
1
vote
1answer
51 views

Things that I am not sure about “LASSO” regression method

I have read the chapters that are related to "LASSO" regression in: The elements of statistical learning (Tibshirani et al.) Statistical Learning with Sparsity: The Lasso and Generalizations. (...
1
vote
0answers
18 views

Negative estimated values [on hold]

I'm using Weka API to make a prediction with SVR. My dataset contains 499 records. In the outpout of the program, I get some negative predicted values. Is that due to problem of Overfitting? If yes, ...
0
votes
0answers
15 views

Factors for binary variables [on hold]

Is it necessary to convert binary variables to factors? Or should I do it only if I have categorical (>2 levels) vars? Also, does it depend on whether a binary variable is a predictor or a response ...
1
vote
0answers
29 views

Name Entity Linking Algorithm

Suppose, I have two sentences, Cameron is the PM of England . He decided to step down . Cameron was trying to keep England in EU . Mr. Cameron could not do it . These two sentences have two ...
0
votes
0answers
7 views

How to use Artificial Bee Colony to optimize the gamma and sigma^2 parameter of LSSVM? [on hold]

I have downloaded an Artificial Bee Colony package from http://yarpiz.com/297/ypea114-artificial-bee-colony and tried to apply it into my work on finding ways optimize the gamma and sigma^2 parameter ...
0
votes
0answers
16 views

how to measure clustering task with unlabelled data set [duplicate]

I wanna know, how to measure the accuracy of a clustering method when we deal with data set without an a priori knowledge about class belonging ? (the data used for the clustering task, do not contain ...
0
votes
1answer
10 views

Q-Learning: is the reward cumulative or the delta between the previous and last state?

Say you are training a Q-Learning function for an agent to play a game (like Defender) in which you use the game's score as the reward: (source: https://en.wikipedia.org/wiki/Q-learning) Should ...
1
vote
0answers
13 views

Post Address Extraction from webpages using Machine Learning [on hold]

We are trying to extract addresses from webpages (specifically small business sites like restaurants, salons etc). I believe address is a structure (street, city, Zip.) There might be some exceptions ...
0
votes
1answer
24 views

How to use machine learning to determine if user signing in from a random location is an anomaly?

We have data that shows usernames and their IP addresses when they connect to a particular server. The data also contains IP address to geolocation mappings. So our data also contains fields that show ...
0
votes
0answers
35 views

Recommend a optimization book with more coding examples?

I am interested in continuous optimization problems. However, I feel it is very difficult for me to understand the classic books such as Convex Optimization or Numerical Optmization. My problem with ...
2
votes
0answers
20 views

How does one interpret histograms given by TensorFlow in TensorBoard?

I recently was running and learning tensor flow and got a few histograms that I did not know how to interpret. Usually I think of the height of the bars as the frequency (or relative frequency/counts)....
3
votes
1answer
13 views

Is there a standard geometric way to apply cross over/mutation in a genetic algorithm

I am currently building a genetic algorithm to tune n parameters where n will probably be in the range of ...
0
votes
0answers
31 views

What is maximum likelihood estimation in logistic regression? [duplicate]

Can you please explain in simple way. Is it so important in logistic regression?
0
votes
1answer
17 views

A linear learner has high bias, because when the frontier between two classes is not a hyperplane the learner is unable to induce it

Can someone explain to me what this sentence means: A linear learner has high bias, because when the frontier between two classes is not a hyperplane the learner is unable to induce it. The ...
0
votes
1answer
9 views

Correlation based feature selection(CFS) tool

Is there any tool or script that was implemented for correlation based feature selection? My feature vector data is in a large-scaled data file, so if I use tools like Weka for feature selection, I ...
1
vote
0answers
25 views

Implementation of PCA using SVD without creating covariance matrix

So I'm currently taking a Machine Learning course and have correctly submitted my implementation of PCA. I used SVD. Here it is Octave. ...
0
votes
0answers
12 views

How to learn machine learning techniques on thermal model like Nest does?

I am trying to build some smart home devices by myself. And I am very interested in build some kind of algorithm like Nest Thermostat does which is able to learn the characteristics of the house and ...
0
votes
1answer
20 views

Consequences of overlap between training, validation and test data

If I'm splitting my data in training, validation and test data to assess different (sub)sets of features for my task. What are the consequences if I (by mistake) split my data incorrectly? In the ...
0
votes
0answers
13 views

What is node impurity/purity in decision trees in plain english? Why do we need it?

Is it more important in classification than in regression analysis? Do we measure it with Gini index? If so, what are the usual values and implications?
0
votes
0answers
5 views

Torch - SparseLinear nn to handle large inputs and large output for a prediction problem

I'm pretty new to the magic of torch7 and seek your help/advice for a problem of mine. Context: I am working on a prediction problem. We observed a certain pattern in our values and would like to ...
0
votes
0answers
18 views

Input layer in Neural Network with different vocabulary size

I want to build a Neural Network where each neuron in the input layer will have different size. For instance, x1 = [0 1 0], x2 = [13 4 5 1 9 0], x3 = 7... Would it be possible to train this model? ...
-1
votes
0answers
16 views

Deciding Minbucket size in R

What is the criteria for selecting minbucket size in CART in R? Is there any formula for choosing this, based on the number of observations?
0
votes
1answer
35 views

How can I know how 'descriptive' my data is?

I'm an undergrad learning about Statistical/Machine Learning and I've implemented and fitted some models now using methods such as Neural Networks and SVM. I've noticed that when testing some datasets ...
0
votes
1answer
39 views

Why does Geoffrey Hinton say in his Coursera course that gradient magnitudes can vary widley when training Neural Networks?

I was watching his coursera course video on RMSProp and he said in a paraphrase: Gradients magnitude vary widely. I was wondering, why is it that they vary widely? I had a guess but wanted to ...
1
vote
2answers
57 views

Suggestions for appropriate regression models? [on hold]

The image is like a larger version of the one posted, but not as clear. I am trying to find a model that can fit to that pattern so that I can identify when there is a break in the pattern. I am ...
4
votes
1answer
82 views

What are multi-variable calculus pre-requisite for Machine Learning

I wanted to complete calculus pre-requisites for machine learning class. I am doing an online course of multi-variable calculus. Can someone please suggest what lectures after Lecture 15 are relevant. ...
5
votes
3answers
94 views

What is the best way to detect repetition in xyz data for purposes of splitting data?

I'll use this picture to explain What I want to do is define some patterns as trained patterns. Then given data I want to be able to determine if the pattern exists in the dataset, and if it does ...
3
votes
0answers
37 views

Perceptron trained on time series always predicting the same answer

Using the model from theano's tutorial (http://deeplearning.net/tutorial/mlp.html), I'm training a 3-layers perceptron with log returns over a very large dataset (~55,000 points). The output's layer ...
1
vote
0answers
19 views

Gradient descent vs Contrastive Divergence

What are the differences (if any) between gradient descent and Contrastive Divergence? I understand how gradient descent is used to train neural networks via back-propogation, but I've just started ...
3
votes
0answers
30 views

K-fold cross-validation for time series with dynamic target variable (Scikit)

I would like to do a K-fold cross-validation on time series data (market data) with a two class classification target. My test folds must be forward looking and of a fixed size ...
0
votes
1answer
23 views

How do I add more training data to pre-trained deep learning net

Am kind of new to deep learning. I have however trained a number of face images and achieved relatively good recognition rate. Now my question is if my client will be taking a few more pictures daily ...
2
votes
1answer
33 views

SVM training and testing error interpretation

I am new to machine learning and I just used SVM for the first time to analyze my dataset... Now I have created a figure that displays the training and testing error of the model as a function of ...
1
vote
1answer
31 views

Which are the suitable classification algorithms when the number of categories are more than 1000

Combination of categories is not possible as each class is a distinct brand. One similar challenge was classifying objects using images (link below) but I could get any specific direction from few ...
0
votes
0answers
4 views

Hard partitioning of the association matrix

I obtain a co-association matrix $n \times n$ that corresponds to the maximum likelihood estimate of the probability of pairs of variables being in the same cluster. Further suppose that there are $k$ ...
0
votes
0answers
16 views

python tensorflow: run on GPU or off-the-shelf dev board [on hold]

Beginner question : Anywhere may find a source code or tutorial, regarding implementing Python & tensorflow codes onto either GPU or dev board such as RaspberryPi ? For example, maybe using a ...
2
votes
0answers
51 views

machine learning techniques for longitudinal data

I was wondering if there were any machine learning techniques (unsupervised) for modelling longitudinal data? I've always used mixed effects models (mostly non-linear) but I was wondering if there are ...
0
votes
1answer
56 views

Feature/variable selection with categorical variables [on hold]

My goal is to compare several machine learning algorithms for sales prediction (logistic regression, neural network, random forest, svm -> classification problem, whether the sales will go up or down) ...
-1
votes
0answers
21 views

cluster external validation [on hold]

I am using ELKI in order to perform location clustering with DBSCAN and OPTICS. My data set include 30 participants but it is not labeled but I do have pair of coordinates (e.g. home, work, etc) as ...