# Questions tagged [regression]

Techniques for analyzing the relationship between one (or more) "dependent" variables and "independent" variables.

26,464 questions
Filter by
Sorted by
Tagged with
12 views

In every course I have taken, I was taught to use the residual sum of squares as (part of) the loss function in regressions, either in simple OLS, lasso or other linear regression methods. Recently I ...
1 vote
24 views

### How to check confounding and mediation in large dataset?

Given a large dataset, one cannot possibly check every model. In particular, it does not seem clear to me that one can check confounding or mediation in either cases. How does one check confounding/...
• 839
43 views

### "Survival" vs. "Hazard" : When to Use Which?

When dealing with Survival Analysis, we create models that estimate two properties: Survival: Survival Probabilities tend to be more straightforward to understand. Survival Probabilities estimate the ...
• 5,728
24 views

### Statistical Models for "Prioritization"?

Are there any general classes of statistical models that are able to perform "ranking and prioritization" tasks? For instance, suppose a hospital has: data on patients (e.g. age, height, ...
• 5,728
399 views

### Testing difference between coefficients of nonlinear regression models

Let us consider following data showing sigmoidal dose-dependence for two distinct compounds (blue and red): I wonder about the best approach of comparing the blue vs red "curves" with ...
• 153
228 views

### Stratification of the continuous y (target) variable in regression setting

Is it wise to stratify the continuous y (target) variable when you split your training and testing data from the total sample in regression setting? Here is the approach in python to do implement ...
• 131
1 vote
47 views

### Question about a paper on Calculating All Possible Regressions

I am currently reading the paper "Computational Efficiency in All Possible Regressions" by Liu and it mentions the following. A quick explanation of what I understand: We have a set of $k$ ...
• 21
1 vote
10 views

### is nrmse scale-dependent?

Im trying to evaluate my regression models using a normalised version of the RMSE, nrmse = rmse(y, y_pred)/rmse(y, y_mean) where y_mean is the array of the same len as y filled with the mean value of ...
• 11
1 vote
30 views

### LinearRegression in Pytorch and sklearn, what is the differnece?

I am currently implementing Linear Regression in Pytorch and sklearn and I get two different Mean squared error (MSE) values for both. MSE is lower for Pytorch Linear Regression. Wanted to ask what ...
• 21
10 views

### Why the author is quite loose when controlling in control variables for exchange rate regression? [closed]

I read a paper from (Han 2020) and from his equation (4) Δ s ...
434 views

### Is "Uncensored Data" necessarily more "Informative" when compared to "Censored Data"?

I am told that one of the main benefits of Survival Analysis models are their ability to handle Censored Data. This is in contrast to standard regression models that are unable to do so. For example, ...
• 5,728
27 views

### Help with Excel's Regression Output

I'm a junior engineer at a small biotech company and have some (real) data from a fractional factorial DoE (3 factors, 2 levels, 4 test conditions with six replicates each). Currently, we use excel to ...
22 views

### Should you clean your data after or before selecting a sample?

Assuming a 500k dataset. For statistical modeling purposes (selecting up to 10% of 500k as a sample). Should I clean the 500k dataset first before selecting a sample or select the sample first and ...
• 101
31 views

### Why is total variation $\sum_{i=1}^{n}\left(Y_{i}-\bar{Y}\right)^{2}=\sum_{i=1}^{n} y_{i}^{2}$? [closed]

I've been interested in Econometrics and the book I use is Econometrics by Badi H. Baltagi, 5th edition. I tried to answer some of the problems. However, one problem from chapter 3 no. 2 got me ...
18 views

### Interpretation of binomial regression in R

I'm running a regression to see if theres a positive or negative relationship between cvdrst and smkcigst, but I'm not sure how to interpret this regression also why is the data for smkcigst NA, even ...
• 1
20 views

I'm using Dr Frank Harrell's code in RMS 2nd edition. He goes into sparse PCA. Does anyone know how to code a regression model after getting the sparse component grid? ...
• 21
39 views

### Adding Controls to Staggered Difference in Difference Regressions on Stata

I am running a staggered diff-in-diff model, looking at legalization's effect on various variables. For context, only a percentage of all states have legalized, and the year they legalized differs ...
1 vote
14 views

### VAR model with AR(p) and ARMA(p,q) data?

I want to estimate a VAR-model with 6 variables, all of them are stationary. But when I analyse the time series by examining ACF, PACF and auto.arima in R. ...
25 views

### Fitting Sparsed Constrained regression with non-negative coefficients adding to 1

I see a similar problem in How do I fit a constrained regression in R so that coefficients total = 1? Specifically, my model is $Y_i= \pi_1 X_1+\pi_2 X_2 +...+ \pi_K X_K +\epsilon_i$ with $\pi_k \ge 0$...
21 views

### CAPM Estimation

Please that might sound basic for all of you but I am not an expert and I need to estimate the following model using OLS regression: R= a + β1 RM + β2(z)RM + ε (the model is called conditional CAPM, ...
• 11
8 views

### regression analysis in brand funnel

What regression can I use for brand funnel? The participants who do not choose a brand in the consideration, can not pick the brand in the conversion stage due to filtering. However, this is possible ...
33 views

### Is it possible to estimate IPTW in two different subgroups to evaluate interaction? (Subgroup Balancing Propensity Score?)

This questions needs a toy example to be explained. I apologize if the question is not clear. Suppose we have an observational study in which we want to evalute the association between exposure to ...
• 578
43 views

### Applying log transformation to input data has almost no effect on pearson correlation, what does that tell me about my data?

I have a data set where some x input has a 0.59 Pearson correlation with variable y (sample size is about 300). After performing simple linear regression I get the following standardized residuals ...
• 123
1 vote
23 views

### Violation of application requierements / assumptions

As far as I know all methods / models making assumptions about data distribution, data scale, etc. but whenever I read a paper (political sciences) the researcher(s) are violating them (some). E.g. ...
• 11
15 views

### The correlation coefficient with a priori intercept and slope [closed]

What does the formula for the product moment correlation coefficient look like if the intercept and the slope are given a priori?
43 views

### What does it mean if my confidence interval includes zero with a significant p value in linear regression analysis?

I performed linear regression analysis to assess the associations between continuous variables. I found a significant p-value but my confidence interval includes zero. What does it mean? Here are the ...
• 51
17 views

21 views

### Can I convert a classification problem with an ordinal dependent variable in a regression problem?

It looks interesting to me to know about the variables related to the students performance, so I started to look into the following dataset: https://archive.ics.uci.edu/ml/datasets/Higher+Education+...
• 101
1 vote
26 views

### How to predict multiple future values in a linear model in R?

So i currently have a data set consisting of the Year, Credit Hours, and Number of students. I have been trying to predict future credit hours by the number of students. ...
• 11
63 views

### My CNN is not learning but just memorizing [duplicate]

So there has been similar posts but none of them solves my problem, so I decided to created a new question. I'm working on a regression project where I intend to use CNN to predict material properties,...
189 views

### What's WRONG with my multiple regression model

I am working on a regression model, more precisely, multiple regression model for predicting one single value. I have a dataset of cars and some technical data. For example, I have the following ...
• 59
1 vote
6 views

### Design loss function for model-based reinforcement learning

I'm doing some model-based reinforcement learning, and I'm stuck at how to better design the loss function for fitting the dynamic model of the environment. In continuous state and action space, the ...
• 1,643
1 vote
19 views

### Showing a regression model is unidentifiable? [duplicate]

I am following a tutorial in which we are looking at a risk regression model (the Cox’s proportional hazards model. In particular, the hazard rate is modelled as  \lambda(t) = \lambda_0(t) \exp(\...
• 471
31 views

### How to do forecasting from linear regression when covariates are correlated

Consider I have in situ measurements (samples) of 4 variables: Temperature, salinity, pH, depth I know how temperature will change and want to calculate the expected change in my other variables ...
• 23