# Questions tagged [regression]

Techniques for analyzing the relationship between one (or more) "dependent" variables and "independent" variables.

28,255 questions
Filter by
Sorted by
Tagged with
82 views

### What is R^2 if SSE = SST = 0

I want to acknowledge that this is a trivial edge case. As far as I know, the only case where this will occour is when fitting an n degree polynomial(with a constant term) to constant data. For ...
16k views

### Are splines overfitting the data?

My problem: I recently met a statistician that informed me that splines are only useful for exploring data and are subjected to overfitting, thus not useful in prediction. He preferred exploring with ...
16 views

### Estimating price elasticities of demand from four step transport model

My question is specific and concerns transport modeling. I am trying to find a way how to estimate price elasticities of travel demand from a 4-step transport model. With this model it is possible to ...
1 vote
387 views

### Logistic regression model; too many independent variables? (listening duration of music genres)

I'm building a logistical regression model to predict the gender of users based on listening duration of music genres. My main worry is that I have over 40 different genre's and I'm concerned that ...
297 views

### L1 & L2 double role in Regularization and Cost functions?

I'm confused about the way L1 & L2 pop-up in what seem different roles in the same play: Regularization - penalty for the cost function, L1 as Lasso & L2 as Ridge Cost/Loss Function - L1 as ...
1 vote
62 views

### Is the iid assumption in Linear Regression necessary?

In linear or logistic regression, we have the following (adapted from Foundations of machine learning.): As in all supervised learning problems, the learner $\mathcal{A}$ receives a labeled sample ...
1 vote
5 views

### Online learning with random action set?

Suppose I have an online bayesian linear regression problem for which I can updated the posterior distribution of parameters. Using this posterior, I want to make a point forecast by sampling from it. ...
76k views

### What does negative R-squared mean?

Let's say I have some data, and then I fit the data with a model (a non-linear regression). Then I calculate the R-squared ($R^2$). When R-squared is negative, what does that mean? Does that mean my ...
10 views

### Regression model: Y = aX1 + b(X2)^2 [closed]

I received an exercise with requirement of finding a regression model of Y = aX1 + b(X2)^2 for the given data tabe. Thanks in advanced!
25 views

### linear regression can it be used for one group?

Can i study correlation and linear regression for only one group that answered my questionnaire? the two variables of my research are "gamification" and "motivation" but how can i ...
9 views

### function for multiple and multivariate regression in Python [closed]

I have two matrices, lets say Feature_1 and Feature_2. They have the same size, ...
18 views

### need some advice regarding finding appropriate statistical method. (weighted, Bayesian, penalized) logistic regression

My study aims to determine the causal relationship between a subset of predictors (consisting of 13 variables) and one binary response variable. We have unbalanced data because the number of samples ...
70 views

### Does R-squared help assess statistical significance?

I have a R-squared of 0.4787. I know it indicates the model does not fit very well with the observations, but that is what I got so far using R. My question is: does R-squared help to access ...
1 vote
2k views

### How to interpret Jensen Alpha statistical significance?

When you regress portfolio excess returns against relative benchmark excess return you get a model in which the beta (slope) could be interpreted as the one you get from the CAPM, that is systemic ...
15 views

5 views

### Measuring the Impact of Recurring Events

What models can I use to measure the impact of a recurring event? I know that event analysis can gauge the impact of a one-shot event--for example, the impact of an economic policy (which only ...
1 vote
22 views

### What is the difference between these two mixed model specifications?

I've been running several mixed linear models in R. I use the lmer function from lmerTest. I also ran the same analyses (or so I thought) in JASP. JASP uses R ...
501 views

### Linear regression with variables which are possibly dependent to each other

I am working on building a linear regression model with one response variable and multiple explanatory variables. For the explanatory variables, I suspect that one numerical variable and one factor ...
1 vote
6 views

### Analyse clustered items from different scales?

I am a non stat person so pls be kind in your reply! What sort of statistic can I use to compare how the items of 3 different Likert scales covariate? My respondents sample is 150 ppl. Each respondent ...
16 views

### Multiplying coefficients of logistic regression to get per 10 unit increase?

I'm working on a project in R where I'm looking at California's census tract-level demographic data in an explanatory logistic regression model. I have 6 demographic variables of interest and am ...
18 views

### GLM with uncertain features

I am trying to model total goals in soccer matches. I ultimately want to predict various odds for a whole future season in advance (so I need a parametric model I can extract quantiles from given its ...
372 views

### Lasso Regression - Finding multiple candidate models

I have 20 predictors and I am attempting to find several candidate models to then test. I am using the LassoCV library, my following code provides me with the alpha and co-efficients of a model. <...
1 vote
60 views

### Why does a neural network perform poorly in case of small loss?

Background I'm building a convolutional neural network (CNN) to predict the response factor (continuous variable) of organic molecules. As input, I use 86x86 onehot-encoded matrices that represent the ...
1 vote
1k views

### How to calculate influence of variables at ROW LEVEL?

There are several algorithms which give relative importance of variables at OVERALL Model level. But the most influencing variable might not be the reason why a particular row might get higher or ...
26 views

### Interpreting coefficients of beta regression

I have implemented a beta regression and am a little confused on how I should interpret the coefficients of my model. For context, both my independent variables and dependent variable are expressed in ...
1 vote