428 views

### Should a non-significant adjustment variable be kept in a regression model? [duplicate]

I'm working with a structural equation model to study influenza infection risk. As age is a known risk factor to explain infection, I therefore adjusted my infection outcome on the subjects age class. ...
224 views

### How to interpret logistic regression output? [duplicate]

I have the R output for the logistic regression model. It seems that only the intercept and psa are statistically significant. Does that mean I should remove sorbets_psa and cinko from my model and ...
131 views

### Removing insignificant variables? [duplicate]

Suppose you fit a linear regression model on some data with 10 variables. The F-statistic shows that 3 of them are significant (p < 0.05) , 2 are within trend (0.05 < p < 0.10), and the other ...
64k views

### What is the difference between “factors” and “covariate” in terms of ANCOVA? [duplicate]

I am a bit confused on the term "covariate". It seems like the term can mean two different things. In ANCOVA, the term is used for the third variable that is not directly related to the experiment. ...
10k views

### How to identify which features are more likely to contribute to the desired outcome?

This question is in tandem with my earlier question here: Using ML approaches to build a recommender engine for sales team However, now I'd like to discover insights about x features as ...
2k views

### When is it better to use Multiple Linear Regression instead of Polynomial Regression?

In the course I've just learnt Multiple Linear Regression and Polynomial Regression. Why would you ever use Multiple Linear Regression when Polynomial Regression will always fit the data better?
14k views

### How to interpret non-significant effect of a covariate in ANCOVA?

I need to use ANCOVA to analyse effect of executive functions (EF-covariate) on scores collected during a test. I want to compare this effect between a control and schizophrenics group (variable ...
2k views

### How to remove one of the factor from the model?

We have a variable "pos" in the regression which has three values : guard, forward, and center. My regression looks like y~a+factor(pos) But one of the factor's value is insignificant (i.e. forward). ...
15k views

### Regression - What to do with insignificant variables?

Please pardon me if you find this question very silly but this doubt has been troubling me for some time now whenever I want to run a regression. I am working on SAS. I have a dataset which has 24,...
2k views

### what to do if all control variables are insignificant and none affect the main effects?

All the control variables were there because they affected the dependent variables in previous studies. However in my dataset, all are insignificant and do not affect the main effects. Should I ...
4k views

### Are insignificant variables included in calculation of predicted probabilities?

When calculating the predicted probabilities in a logistic regression model, do we consider all the variables or just the significant ones? For eg: Let's say my model has: dependent variable Y and 3 ...
2k views

### Help writing covariates into regression formula

Can someone take a shot at writing a formula using covariates into a linear regression formula? I need some feedback to see if I am on the right track. Much appreciated! Here are my basic ...
204 views

### Is there a counterexample to the claim that throwing away “insignificant” predictors doesn't generally harm a model?

I have learned from this site (see question here), and from Frank Harrell's Regression Modeling Strategies that generally speaking one should not remove variables because they are insignificant. I was ...
177 views

### Model selection, issues of judgement

I have a general question on model selection strategies in regression models. In my research, the main goal is rarely prediction but almost always estimation of effects of certain variables. I have ...
716 views

### ROC analysis and death/recurrence as binary marker

I am doing ROC-curve analysis on my patient cohort, and I am wondering if it is statistically ok to use "death" and "recurrence" as the binary marker, even though these parameters will be influenced ...
483 views

### Difference of variable selection and importance estimation

Isn't variable importance estimation a necessary prerequisite for variable selection? Is there any use case where you want to select non-important variables for your model? So, why is variable ...
247 views

### When the effect size of a covariate is high and yet not significant

I was reading this answer to the question on whether all covariates should be kept in the model or just those that are statistically significant, and I noticed the point number 2: The effect size ...
790 views

### Insignificant squared term but significant linear term

I am estimating the following model: $\ln(y) = \alpha + \beta_1x + \beta_2x^2$ $\hat\beta_2$ is insignificant while $\hat\beta_1$ is significantly different from zero. However they are jointly ...
360 views

### Is it ok to repeat MANCOVA until all interactions are significant

In order to enlighten the relation of three (related) scales describing psychopathology (1 anxiety score and 2 shame scores) with demographic data (gender, place of residence, age etc) collected by ...
562 views

### Linear Regression Feature selection: multiple-regression p-value filter versus Lasso / Recursive Feature Elimination

I have been thinking of this problem for days and I can't seem to arrive at a conclusion for feature selection in Linear Regression. Please tell me what is wrong with this simple approach versus ...
497 views

### GLMM with 2 insignificant variables has lower AIC or BIC compared to same model without those variables…?

Background This post has been heavily edited from its previous version (three months ago). I am investigating habitat selection of 35 territorial wolves over several years of denning seasons (41 ...
571 views