1
vote
2answers
50 views

How does random Forest work for regression?

I am an absolute beginner in field of machine learning, I started doing titanic assignment in Kaggle and found(read some where) Random Forest is the best fit. I started reading about random forest and ...
0
votes
1answer
14 views

How to use a set attributes of an entity at different time snaps to make predictive analysis?

The problem is to come up with a classifier for any task based on a set of attributes of an entity having different values at different times. For instance think about football players and their match ...
2
votes
2answers
52 views

Which property of count data make mean-variance dependency?

I have read about the fact that, there is dependency of variance on mean of count data.In most of cases they do variance stabilization transfomration as preprocessing step of data modeling. I wonder, ...
1
vote
3answers
65 views

Is it necessary to scale the target value in addition to scaling features for regression analysis?

I'm building regression models. As a preprocessing step, I scale my feature values to have mean 0 and standard deviation 1. Is it necessary to normalize the target values also?
0
votes
0answers
29 views

What is task-loss function?

I looked into "Multi-Output Learning for Camera Relocalization" research and faced with the following part (2.2 The Direct Regression Approach): Given a set of RGB-D frames with known camera poses ...
2
votes
1answer
23 views

How to isolate impact of event in a product's lifecycle?

I'm trying to figure out how a single event affects sales numbers of a song. For example, see what the effect of being featured in iTunes store compared to songs with comparable previous download ...
0
votes
1answer
27 views

Why, when I scale my data set, glmnet gives error?

I'm using glmnet for building the regression models. My data are already log-transformed. when I scale my data set (zero mean, and SD=1), I get the following error: ...
0
votes
0answers
20 views

Prediction using Support Vector (SV) method in R

I came to know that using SVM method we can predict the future value more accurately than other normal methods (like ARIMA). My question is how do we give the future index value (let's say 101 when we ...
9
votes
2answers
613 views

What does the name “Logistic Regression” mean?

I am checking an implementation of Logistic Regression from here. After I reading that article, it seems the important part is the find the best coefficients to determine the sigmoid function. So I ...
2
votes
2answers
77 views

How to build a prediction model for exam score based on previous scores

I am trying to construct a formula, which will take student's previous exam results (for ex: SAT) taken at particular dates and predict his future test result. One X is previous test result 1; ...
2
votes
1answer
40 views

Model for probability of song reaching top 10 ranking, over time?

I'm trying to model the probability of a song reaching Billboards top 10 over time. My data has the columns "Day since release", "If reached top 10". For example, [12,1] means the song hit top 10 on ...
1
vote
0answers
30 views

PCA + L1 equivalent to elastic net?

I am performing a logistic regression on a rather big dataset (700k+ samples and 1k+ features). I suspect that a lot of these features will be highly correlated and multicollinearity can be an issue. ...
4
votes
2answers
44 views

When do kernel based method perform better than the regular

I am used with linear models. I can see rising use of kernel based method particularly in machine learning. The following is an example Gaussian kernel using ...
0
votes
0answers
35 views

Neural-Net style pattern recognition with an unknown/varying number of inputs?

Say for example I had a weighted graph such that each node had an associated value. The nodes' values are given by some function of the edge weights and the number of edges as well as the node's ...
3
votes
2answers
72 views

Good machine learning algo for partial derivatives?

Does anyone know of good robust algos to estimate partial derivatives of a regression model? I am talking about a general regression model like this: $\mathbb{E}(y|x_1, x_2, ... x_n) = f(x_1, x_2, ...
0
votes
0answers
14 views

how to implement linear or non linear regression for 3d position estimation?

I am a beginner in Machine Learning. For my project I need a regression algorithm that can estimate the 3D position of a device based on some constraints (moreover inputs). I know how to implement ...
2
votes
1answer
58 views

For a model like this what performance measures can I calculate and how?

Methods: From the machine learning literature, I understand different parameters can show performance of model in machine learning. I would briefly expand my understanding with confusion matrix: ...
1
vote
0answers
16 views

How to assess the importance of the features which come from intersection of features of the two models?

I have two models from two different data sets. Model 1 contain 50 features and model 2 contain 40 features. the intersection of features of model 1 and 2 is 10. so how can I assess the relative ...
0
votes
1answer
17 views

How to compare the nested models which each of them comes from diffrent dataset?

I have four nested models.Every of them learned from different data sets. now I want to compare these models together.normally people try to compute the F-satistics. But for my case, it's bit harder, ...
3
votes
2answers
36 views

What model would be appropriate for predicting electrical consumption given multiple (mostly) independent variables?

I have about 1000 samples worth of daily electrical consumption for a building. I'd like to build a predictor based on a number of observable inputs, including: daily temperature (continuous) hours ...
0
votes
1answer
58 views

How to compare models from different but related datasets?

I'm building regression models on four the different but related data set and at the end, I want to test the significance of models. Since my models are built in a different data set, it's not ...
1
vote
1answer
18 views

Regression Gaussian Estimates instead of points

I am using a support vector regression is order to get estimates of a variable y. I want to receive a probability distribution of my estimates and not just point estimates. I want to predict Gaussian ...
1
vote
0answers
25 views

Binary classification of dated text documents with seasonality

I have a collection of training documents with publication dates, where each document is labeled as belonging (or not) to some topic T. I want to train a model that will predict for a new document ...
0
votes
0answers
34 views

Conditional or Joint Probability under Various distributions

In various statistical models the baseline equation (like in Naive Bayes $$\mathrm{classify}(f_1,\dots,f_n) = \underset{c}{\operatorname{argmax}} \ p(C=c) \displaystyle\prod_{i=1}^n p(F_i=f_i\vert ...
0
votes
0answers
18 views

Regression line fit for linearly increasing data with manual reset

I've a linearly increasing time series dataset of a sensor with value ranges between 50 to 150 on which I've implemented a simple linear regression algorithm to fit a regression line, and I'm ...
1
vote
2answers
228 views

Estimate ARMA coefficients through ACF and PACF inspection

I know that this is probably a question that's been asked plenty of times, but i haven't seen an answer that's both accurate and simple. How do you estimate the appropriate forecast model for a time ...
0
votes
0answers
28 views

What machine learning tool is best suited for taking time series data as well as descriptive data and making a binomial classification

I have an interesting task of utilizing log data from computer servers in a server farm and predicting if a particular server is likely to fail in the next 24 hours. My data set will be comprised of ...
1
vote
1answer
46 views

Estimation in Naive Bayes

I have a very silly question. In Multinomial Naive Bayes Classifier, which parameter estimation do we use, is it Maximum Likelihood or Maximum A Posteriori? If any one of the esteemed members may ...
0
votes
1answer
34 views

How to compare the significance of two models from two different datasets?

I have two different regression models which I learned from two different data sets. Is there any statistical method which shows the significance of models based on the number of parameters and cross ...
0
votes
0answers
20 views

What are the best criteria to select the model for Lasso regression?

I have two different formulations of the Lasso regression for the same problem. For each formulation, I selected the best model based on cross validation error. But Now, I want to compare two models ...
1
vote
1answer
31 views

Is there a stats tool for this analysis I run in excel?

I am trying to find a statistical or machine learning tool that replicates this analysis I am doing manually in excel. Each row in my data set is a user. ...
7
votes
2answers
365 views

Why would anyone use KNN for regression?

From what I understand, we can only build a regression function that lies within the interval of the training data. For example (only one of the panels is necessary): How would I predict into the ...
0
votes
1answer
49 views

Regression model for $f(x_1, x_2) = a + b x_1\log x_2$

Which regression algorithm do I need to use to fit the coefficients of $f(x_1, x_2) = a + b x_1\log x_2$? Will linear regression with an independent variable $x_1 \log x_2$ work?
0
votes
0answers
18 views

Classification More Robust Than Regression

Are neural networks using classification more robust / reliable than using regression to produce a single value? The only reason I would think so is that it would be easier for the network to adjust ...
1
vote
0answers
41 views

Random Forest regression model in R and data overfitting

I have trained my random forest model on a 74,000 training examples where each example consists of two proteins Amino Acids sequence (20 characters) and some numeric values representing the similarity ...
1
vote
0answers
47 views

Online model training in R, without a static data

Let's say I have a model in R, a regression tree created by "glm",using "data1" dataframe: Model1 = glm(DepVar ~ . ,data=data1,family="binomial") Is there a way ...
0
votes
0answers
37 views

How to handle the error of glmnet package for non-positive lambda?

I'm using glmnet package to learn regression models,it works fine, but for some models, I face an error and my script stops running. Here is my effort: ...
0
votes
1answer
121 views

Intuitive explanation of Bayesian logistic regression?

I'm looking for an intuitive explanation of Bayesian Logistic Regression (I'm using it for texts if that's relevant). It seems that this article presents it, but it's, uh, way too mathy. Thanks!
1
vote
0answers
53 views
1
vote
0answers
56 views

How is L2 Boosting Different from a Big Regression Tree?

I'm learning about boosting. I think I understand how adaptive boosting works for classification. I'm trying to get some intuition for regression boosting. At each iteration, adaptive boosting ...
3
votes
1answer
319 views

Choosing the right forecasting technique

I'm currently attempting to forecast visitor data for stores. My dataset includes daily visitor totals of three years. Note that the dataset isn't complete (stores can be closed for a few days, etc). ...
0
votes
0answers
9 views

Learning a multivariate polynomial with dependent coefficients

I have a polynomial of the form $K^2((a-i)^2 + (b-j)^2 + c^2) = (ct)^2$ where $a,b,c,t$ are unknowns. I have multiple observation points for the values of $i,j,\&\ K$. Can I use some technique ...
0
votes
1answer
18 views

Expected error of best possible linear fit?

In my textbook, there is a statement mentioned on the topic of linear regression/machine learning, without a proof or rigorious justification, which is simply quoted as, Consider a noisy target, $ ...
0
votes
0answers
56 views

Google Prediction API Flaws

I have been testing the google prediction api https://developers.google.com/prediction/ It seems to be excellent, i gave it 5 features so it can predict a regression problem, the API fitts the data ...
0
votes
1answer
132 views

Explanation of the Regression Plot in the Matlab Neural Network Toolbox

What does the Regression Plot in the Matlab Neural Network Toolbox show? I thought I understood it when I looked at a univariate regression plot, but I've just plotted one for multivariate regression, ...
1
vote
0answers
38 views

How should I handle variables whose data points have varying degrees of predictive power?

I'm trying to determine which type of learning algorithm is best for making predictions on my data. My data set consists of several independent variables, each of which is accompanied by an ...
4
votes
3answers
328 views

Any algorithms better than polynomial regression

I am trying to fit a baseline through my data, and I am not getting close enough with polynomial regression. I used gradient descent to set the parameters. Are there any other ways or algorithms that ...
0
votes
1answer
51 views

Denormalizing Data

I am applying Polynomial Regression to my data, however the parameters theta were always =0, i noticed that my y data or output is too large in the order of 100000 so i normalized y, i got very good ...
1
vote
0answers
63 views

How can I improve the accuracy of my logistic regression code, which tests the accuracy using the 10-fold cross-validation technique?

How can I improve the accuracy of my logistic regression code, which tests the accuracy using the 10-fold cross-validation technique? I have implemented this code using ...
3
votes
1answer
113 views

How to choose the right number of parameters in Logistic Regression?

I am studying Andrew Ng's Machine Learning lecture notes. I understand either we can manually choose the number of parameters, or we can use regularization to make it correctly fit. I was wondering ...