# Questions tagged [regression]

Techniques for analyzing the relationship between one (or more) "dependent" variables and "independent" variables.

30,131 questions
Filter by
Sorted by
Tagged with
1 vote
41 views

### Comparison of two test metrics

I'm trying to compare two test metrics (Metric A and Metric B) to determine which one better predicts a delta value, which represents a Euclidean difference. I am unsure how to determining which ...
• 41
1 vote
73 views

### GAM: Smooth and factor interaction

I am currently working on a GAM. It includes a smooth-factor interaction. I am trying to decide which function is the one I need. ...
• 49
495 views

### Variable is significant in multiple linear regression but not in t-test of the subgroups

I am getting different p-values for a variable in t-test and its coefficient in multiple linear regression so I am unsure which one to believe. As an example, my hypothetical dataset consists of ...
31 views

### Confusion regarding PCA, FA, and PCR?

I learned here: Is PCA followed by a rotation (such as varimax) still PCA? About the relationship between PCA and FA and how they each provide a perspective for looking at the same thing. However, at ...
• 1
30 views

### "Important" data points causing problems with nonlinear regression bootstrapping

I am trying to model radar backscatter of a planetary surface. The power which is scattered back to the instrument depends on the angle at which the it observes the surface. The shape of the resulting ...
1 vote
38 views

### What changes in swapping predictor and outcome variables in logistic regression

I have a dataset containing a variable representing the source of isolation of a bacterium, with 2 factors, along with multiple other binary variables indicating whether the bacterium is resistant to ...
14 views

### Wanting to create a cut-off point for measurement (Length by width) at which an adverse outcome occurs

I am working on a project investigating dimensions of tears in shoulders and how it affects retear rate after an operation. From the literature, age, and tear size (Dimensions AP [width], ML [length], ...
1 vote
28 views

### Time series cross validation for trend + tree model

I have a time series data set with ~3 years of data sampled daily from 2021 to 2024. The data set exhibits a trend, and clear cycles with periods of 1 year and 1 week. My goal is to forecast ~3 ...
1 vote
142 views

### Regression spline for time to allow for slope changes

Suppose we have a regression / survival model where we would like to model follow-up time using a regression spline. Follow-up time has two phases (first treatment active, and second treatment ...
• 859
132 views

### Do tail bounds on probability translate into bounds on expectations?

Suppose I have a bound of the form: $$P(X \geq t) \leq \exp(-t^2).$$ Can I say anything about the expectation of $X$, $E[X]$? In particular, can I get a bound on $E[X]$? Here's the specific case that ...
24 views

### How to identify the most important features that impact an ordinal score?

I have 40 rows of 5 continuous features and 1 ordinal score. What statistical technique is recommended for me to identify which features have the highest impact on the ordinal score? I have looked ...
• 31
23 views

### How can i create a linear regression model not having the exact same dataset

i want to create a data regression between two financial indexes, but they don't have a perfect correspondence in the data of observation (for example one has the relevations for 17/6 18/6 19/6 but ...
1 vote
43 views

### on a linear regression analysis, the determination coefficient is 0.99, but the residuals are not distributed normally. How do I interpret this?

So to preface I'd like to say that this is for homework and I am not very good at statistics. Please explain things to me like I am 5 years old.Also english is not my first language. So the homework ...
• 11
201 views

### Clustered standard error - intuitive explanation

I understand that the standard error is standard deviation of the sampling distribution about some parameter, for example the sample mean or a coefficient in a regression model. I also know that when ...
• 3,382
1 vote
34 views

### Hierarchical multiple Regression Analysis - Interaction Effect

I'm currently sitting on a research project and I got an output which is confusing me. The hypothesis to be checked is: Self-Efficacy (Centered_KOMP) is moderating the negative relationship between ...
84 views

### What if path c’ has a negative coefficient, but X - > Y share a moderate to high Spearman correlation?

I am running a mediation model including the variables $X$, $M$, and $Y$. The Spearman correlation between $X$ and $Y$ is +0.4, while the direct path ...
• 307
23 views

### Should I adjust for time for different baseline entry time in an observational study?

Suppose I have a dataset with n waves. I will select samples based on a specific criterion (e.g., wave i with event=0; wave i+1 with event=1). Therefore, each individual's entry time is different. ...
• 250
35 views

### Multiple Linear Regression/ANOVA Help in Excel

I am working on a linear regression model and keep getting zero as my coefficients and the NUM! error as my p-value. I was told to organize the data this way but was then told by someone else that I ...
256 views

### Intercept significant, but confidence intervals around its standardized β include 0

I ran a HC (‘robust’) regression. The intercept is significant, which is reflected in the confidence intervals around the unstandardized betas. However, the CIs around the standardized β are quite ...
• 41
41 views

### Query about one step in AR-sieve bootstrap

I am trying to understand how an AR-sieve bootstrap works. I am reading this paper: Here are the steps which are to be taken to do a sieve bootstrap:- We are given a sequence $X_1,..., X_n$. We ...
• 295
17 views

### Measurement invariance across groups and time

I want to run a multi-group longitudinal model. Based on prior invariance testing, I can assume scalar invariance across groups and time. So is it appropriate to have both the same intercepts across ...
• 1
223 views

### Estimating effects in the presence of a mediator

Suppose that one is interested to compare the effect of biological age versus "cognitive age" on a variety of outcomes. Cognitive age is measured by testing intelligence. The outcomes are a ...
• 755
20 views

### Correcting data using model residuals

I am trying to follow a method from a paper to correct my data for technical effects. The method suggests to take the central portion of my data to guard against outliers (which I can do), fit a ...
• 55
90 views

### Sample Size for Logistic Regression

I'm carrying out multiple logistic regression with three independent categorical variables each with more than two categories per independent variable. I want to use the EPV (events per variable) ...
• 21
5 views

### Testing difference in Difference for observations repeated over time pre- and post intervention, with control and intervention group

I want to assess whether the monthly payment of a bonus to health workers starting in January 2023 has increased the number of monthly supervisions conducted. The country has 26 provinces, out of ...
24 views

• 205
17 views

34 views

### Propensity Score vs Propensity Score Matching?

I am trying to self-learn about Double Robust Estimation. It seems to me that Double Robust Estimation uses Propensity Scores, but does not use Propensity Score Matching. Here is my understanding of ...
262 views

### Count predictor and binary outcome

Is a binary logistic regression the best approach when I have a count predictor and a binary outcome? Can I apply a multiple binary logistic regression model if I have more than 1 predictor that is a ...
• 311
32 views

### Assessing heteroscedasticity in residuals vs. fitted values graph [duplicate]

I am running a mixed model regression with 3 levels (schools, groups and students). I applied robust standard errors with the R function ...
82 views

### Regression Modelling using lme4 in R

I have GPS collar data on a species of desert gazelle throughout different seasons and want to model the effect of seasonal changes in weather patterns on their movement patterns (e.g. daily distance ...
1 vote
46 views

### Can you use a percentage as the dependent variable in general additive models?

This is more a general question about statistical modeling rather than a project specific question. Can the dependent variable be a percentage in a generalized additive model (GAM)? Is there a ...
• 45
1 vote