# Questions tagged [multiple-regression]

Regression that includes two or more non-constant independent variables.

1,960 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
623 views

### Calculate goodness-of-fit (with deviance) to compare averaged models?

I need to compare the goodness of fit of several averaged logistic regression models by calculating the deviance explained. I'm using the MuMIn package in R to ...
139 views

### Identifying non-linearities in relationship between variables

Logistic regression is often used to identify the effect of $x$ on a binary variable $y$ after adjusting for potential confounders $x_1,...,x_n$. In the medical literature, I will sometimes encounter ...
2k views

### What are the differences between HC estimators and their small sample properties?

I am currently using R to run regression with the following code: ...
1k views

### Overfitting a neural network to a single batch as a sanity check - how small a loss value is small enough and long to run for?

I'm currently developing a neural network for a regression task. Following on from the advice given in places like here, here, and here I'm attempting to overfit my model to a single batch of 5 ...
68 views

### Before using CV-selected Regression model for Inference, shouldn't model performance be evaluated on unused test set?

I just came across a biokinesiology paper that used some Machine Learning methods, but I think there is a flaw in their methodology. The authors had data on stroke patients and used Lasso regression ...
113 views

### using lmer to fit the linear mixed effects models

Edit: I know some people vote this question is off-topic since it is more like a Cross Validated question. However, I am not here to ask about the coding thing (but I might word in the wrong way). I ...
90 views

### Importance of regressors in time series data

Could anyone recommend bibliography or name some useful methods to analyze which (exogenous) variables are most important in determining the value of a time series? For context, I have a random time ...
317 views

### Why do we need to model lower-order effects in models with interactions?

I recently saw a paper with a four-way interaction. That already is difficult to interpret (maybe if you have 1 or more categorical variables but definitely near impossible to interpret if all ...
4k views

### Linear model with both additive and multiplicative effects

In linear regression, the independent variables have an additive effect on the response (level-level regression): $y=\beta_0+\beta_1x+\epsilon$ In a log-level regression, the independent variables ...
428 views

### How to train Prediction model for longitudinal data, with large number of time points?

Given a longitudinal data, that has date (in month-year format) as one of the independent variables and other independent variables being Gross metric tonnes, Tensile strength(UTS), weight per unit ...
327 views

### Equivalence of ANCOVA and repeated measures model

Consider an RCT with individuals i in 2 arms (group, with 0 = control and 1 = treatment) in which one metric outcome (score) is collected at baseline (pre) and after some treatment (post). In an ...
339 views

### Why shouldn't I standardize my predictors when putting them into a regression model?

There are multiple reasons for applying standardisation/mean centre for predictors before putting them into a regression model. However, in the literature, some people do not do so or even argue ...
2k views

### Covariance matrix of multivariate multiple regression coefficients

I would like to perform a regression analysis on a dataset comprising one independent variable (X) and two dependent variables (Y1 and Y2) which may be affected by correlated errors. R's stats::lm ...
4k views

### Is it possible to do a time series analysis with more than one explanatory variable?

I am working on a project, and I am absolutely new to forecasting and not so strong in statistics. I have an employee data for the last 7 years, along with the other variables like economic growth, ...
99 views

### Testing differences between slopes by examining proportions rather than interactions

In a recent article published in Nature Genetics, Francioli et al. argue that the relationship between paternal age and mutation rate depends on what part of the genome you're looking at (intergenic ...
1k views

### Why would I need both a validation set & a test set if I'm not selecting a model?

I have a dataset with two features and one outcome. I was asked to separate the data into three parts such that 70% of the data is a training set, 20% is for validation and 10% for testing. The model ...
3k views

### VAR model for price forecasting in multiple time-series context. How to get "real figures" as forecasts?

Sorry for the rather long introduction, but since I was (legitimately) critizised for not explaining my cause and questions enough, I will do so now. I would like to conduct a (price)-forecast based ...
519 views

### Partial regression plots vs scatter plots for checking linearity

In a multiple linear regression analysis, what is the most suitable plot for checking linearity? I have seen a number of examples that use scatterplots as a preliminary test to use a linear model. But,...
242 views

### Variance partitioning - why be cautious?

I'm about to use variance partitioning to interpret my results of a given model and across models and have come across various criticisms of it most notably by Pedhazur (1982, 1997). Also, the ...
3k views

### Comparing observed and predicted values across several measurements

As a neuropsychology graduate student with some experience in statistics (I'm usually the guy other psychologists come to with statistics problems after trying it themselves but before seeing a ...
3k views

### Why is correlation between y and $\hat{y}$ in a model with and without intercept equal?

I consider a very simple example with two models like this; ...
1k views

### Hierarchical regression with dummy variables

I need to perform hierarchical regression with dummy variables. I also need to check moderation by introducing in the model interactions of these dummy variables and the moderator. My questions are: ...
52 views

### What is the ideal approach to determine relationship between candidate predictors and a dependent variable in a data driven way?

I have asked several related questions (1, 2, 3), but now I would like to ask the most basic questions and hope to get a very solid answer. I have 40 treatment variables, and I am interested to find ...
256 views

88 views

### Ill-behaved, nonnormal residuals of multiple regression: should I be concerned?

I have data on waist circumference (cm) (waist), gender, age and physical activity (vigorous MET minutes per week) (PA). I was trying to run linear regression in R on the model waist ~ gender + age + ...
180 views

### Continuous distributions as independent variable in regression

Problem: My research issue concerns logistic regression where each observation is an area, not a simple point. As such, each independent variable ($x_i$ of $\boldsymbol{X}$) is a distribution of ...
372 views

### Connecting Poisson and multinomial models

Let's say we have multinomial counts $y_{jp}$ (corresponding to observations $j$ over categories $p=1,...P$) that are arranged in a table of $n$ rows and $P$ columns. Then say we have the log-linear ...
3k views

### How to create a regression model object from intercept and coefficients values only (without the database) in R

I want to recreate a regression model based on what was given in a scientific paper. They gave intercept and coefficient terms. I know how to create regression models in R, but is this possible to ...
335 views

### Calculate effect size (e.g., Pearson r) from the output of a multiple regression

I'm looking at a multiple regression analysis in which I'm only interested in 1 of the several variables included in the model. However, the bivariate associations are not reported. I'm wondering if I ...
691 views

### What's the difference between a random intercept and a dummy variable?

I usually work in SAS or R, so when I code a GLM with a random intercept, it's usually pretty easy. However, I've been running into a few problems (too complicated to get into here) where it might be ...
1k views

### Coefficients of dummy variables in multiple regression

I am struggling with interpreting coefficients from a multiple regression analysis with multiple categorical (dummy) variables. I am running a linear mixed model with biodiversity (...
2k views

### Analysis of Multiple Time Series Data with Exogenous Shocks

Real Life ProblemThis one is a tough one and some crowd sourcing seems like a good way to get some feedback. I am trying to determine the effect of Non-Farm Payroll surprises on a subsector of the ...
625 views

### Longitudinal data analysis where meaning and metric of response variable varies over time

Determining what factors predict change over time is a topic of investigation in many fields and there are a variety of readily implemented methods for analysing repeated measures in the same metric. ...
557 views

### What is the best way to simulate data for a linear regression model?

I am concerned with simulating data for a linear regression model. I need to control the means, variances, and correlations (covariances) between the predictors and the criterion variable. In addition,...
542 views

### Standardize continuous predictor variables on [0, 1] scale?

I'm working on a health care regression model predicting # of inpatient visits. My analysis dataset includes a number of hybrid continuous/categorical predictor variables which can hold values on a 0 ...
812 views

### Assumption violations with heteroscedastic data and OLS regression

I'm trying to model the typical performance of an experimental approach I've developed. I have a total of 3000 observations for 72 different case studies. My observations consist of a reading for <...
200 views

### Estimating covariate effects on Likert-type response variable

I am working on a problem where we elicit medical residents perceptions regarding the importance of specific core medical competencies (professionalism, collaboration, medical expertise, etc.) on a 5 ...
10k views

### Fitting a zero-inflated negative binomial regression with R

In this thread, I laid out a problem involving fitting a model that attempts to use minor league baseball statistics to predict success at the major league level (explained in full in the thread). ...