# Questions tagged [regression-coefficients]

The parameters of a regression model. Most commonly, the values by which the independent variables will be multiplied to get the predicted value of the dependent variable.

1,262 questions
Filter by
Sorted by
Tagged with
2k views

409 views

### How does one interpret regression coefficients when no dummy variables nor intercept are dropped?

I am familiar with how to interpret linear regression coefficients when the independent variables are dummy coded and one of them is dropped. And this question helped me understand how to interpret ...
1k views

### Should the logistic regression equation always result in a value between 0 and 1?

I am a medical scientist but an amateur statistician (not even amateur). I have a simple question. Here is the output from a logistic regression examining a number of variables which may predict if a ...
1k views

### Sample Size for Poisson Regression

Recently, I was tasked with a sample size calculation for a study in which the outcome is to be modeled using a Poisson regression (i.e. a generalized linear model). For quick and simple calculations ...
5k views

### How does one extract the final equation from glm poisson model?

I have a Poisson model that is performing well. Now we need to put it into Java code and release it to the world. What is the equation that I plug the Poisson coefficients into? Similar to this ...
165 views

### How to decide whether a variable belongs to a linear model?

I have a set of inputs $x$ and noisy outputs $y$. I think that either $$y = a_0 + a_1 x$$ or $$y = a_0 + a_1 x + a_2 x^2.$$ How can I determine which model was more likely to have generated the data? ...
4k views

### How to interpret p value of regression coefficient which is nearly 0?

When regression coefficient is nearly 0 (in fact in the real model it's exactly 0), what's the meaning of p value (<0.05) of the coefficient? For example, I did a multiple variable regression ...
246 views

### Interpreting GAM Coefficients

I could use some advice interpreting GAM (Generalized Additive Model) coefficients. I get the following results when I call coef on my model: ...
116 views

### Simple regression, switching X and Y, t-test stays the same? (edited)

I did a simple regression where the independent variable was the educational background of the mother. The dependent variable was the language skills score of the child. I switched them around and ...
8k views

### Categorical variables in LASSO regression

I just built a logistic regression model via Lasso Penalization. Now I'm trying to interpret the coefficients. One is "days". I have a coefficient for "days". when I do a normal logistic regression ...
9k views

### Compare coefficients from two separate panel regressions in Stata

I am trying to compare the coefficients of two panel data regressions with the same dependent variable. What I am aiming at is the following: ...
6k views

### When to divide data into training & test set in logistic regression?

I am using Logistic Regression in a low event rate situation. Overall universe: 46,000 Events: 420 Conventional logistic regression models divide the data into ...
3k views

### Do Beta weights from regression have error terms?

I am looking at standardized regression weights (i.e., Beta weights). I was thinking of reporting the errors next to the weights in a figure, but upon some thought I was debating whether such errors ...
450 views

131 views

### Which random effects to include in this GLMM?

In my study growth of plants was measured in different years on different plots (all plants were measured in all years). The question I'd like to answer with my model is: Which factors influence ...
215 views

### regression coefficient in the poisson model [closed]

When we are dealing with count variables we are told not to log transform our data but to instead use a poisson regression. I was wondering.. when it comes Poisson regression, the common formulae is :...
139 views

### Why do coefficients in a binary logistic regression model differ according to the number of predictor variables?

I fit a binary logistic regression model with a single categorical variable, for which I received a coefficient. When I added further categorical predictor variables, the coefficient of the original ...
580 views

### Incident rate ratios with log-transformed variables in Poisson regression

I'm in a bit of a mess with interpreting the output of a Poisson regression model with log-transformed predictors. The predictors are counts, and the log transforms them for the linear part of model. ...
72 views

### Linear regression with $n<p$: Solution of $Ax=b$ that minimizes the $2$-norm of $x$

Consider a full-rank $n\times p$ matrix $A$ and $b\in\mathbb{R}^p$. If $n<p$, I want to minimize the norm $||x||^2=x_1^2+\dots+x_p^2$ over $x\in\mathbb{R}^p$, subject to the condition $Ax=b$. So, ...
2k views

### How to perform a meta-analysis of regression coefficients?

I want to perform a meta-analysis but the included studies use different models to analyze the data. There are Pearson correlation (3 studies), Spearman correlation (1 study) and several studies (~7-...
485 views

### Co-variance of beta coefficients for Dummy Variable regression with intercept

If I have a dummy variable regression output with intercept included (base category as omitted category), and I have to do a hypothesis test for difference of means between two categories other than ...
2k views

### How do you interpret a percent variable with a log-transformed outcome?

It doesn't make sense to log transform my x-variable (for a more intuitive elasticity interpretation), since it is already in a % format, but with a log transformed outcome: ln(y) = B0 + B1X1 where ...
1k views

### Generate predictions from a logistic regression model reflecting the uncertainty of the model

I want to generate predictions from a fitted logistic regression model that reflect the uncertainty of the model (within a classic frequentist framework). To clarify, my objective is not to ...
71 views

### Problem related to OLS estimators

The problem is: Suppose we fit a model Y = XA βA + ε. However, the true model is Y = XA βA + XB βB + ε. A is kA x 1 and B is kB x 1. Show that the OLS estimates of βA will still be equal if XTAXB ...
89 views

### Interpretation of standardized (z-score rescaled) linear model coefficients

I have analyzed some data on vegetation change as a function of change in soil parameters. I compared a dataset from 2001 with a dataset from 2018 (fully balanced). To investigate the change in ...
79 views

### Intercept in demeaned and rescaled regression model

Suppose I have a linear model; $Y=X\beta+\epsilon$ Where $X$ is $(n \times p)$, with the first column of $X$ being an intercept column (consisting only of ones). Now suppose I construct $\tilde{X}$ ...
102 views

### Linear regression with error dispersion dependent on the independent variable

Suppose $y=ax+z$ where $x, y, z$ are random variables with range in $\mathbf R$, $\mathbf E[x]=0$, the probability distribution $p(z|x)$ is 1) normal distribution $N(0,\sigma(x)^2)$ with mean $0$ ...
37 views

### Mixed Effects Model - Some groups have a single value of x

I am working on sales of a B2B company and I have sales volumes of different customers at different price points. Some customers, however, purchased at only a single price point. I'm trying to ...
1k views

### Interpreting non-significant regression coefficients

Out of seven, six of the independent variables (predictors) are not significant ($p>0.05$), but their correlation values are small to moderate. Moreover, the $p$-value of the regression itself is ...
48 views

### Regression: Is it problematic to include a predictor when the outcome variable is based on it?

My question is based on the following discussion we often see when people try to model citation counts for research articles. The outcome variable is citation counts for an article and some typical ...
69 views

### How can a variable have a positive association through logistic regression, yet a negative association through Cox regression?

I am undertaking some medical research using R. My outcome of interest is mortality in the intensive care unit. Data My data looks like this (there are ~15,000 rows). ...
405 views

### Converting a Continuous variable to categorical for Cox regression

In a Cox regression model where our variable of interest is continuous (e.g., a lab measurement); If we want to obtain something other than a unit risk ratio for that variable (e.g., the hazard ratio ...
615 views

### Magnitude and direction of relationship between predictors and dependent in regression

I'm doing partial least squares regression (PLSR), using the df below, to investigate how to predictors (catchment characteristics) influence the dependent (nitrogen in the river). In this data.frame, ...
86 views

### Regression Interpretation conundrum

I am running an OLS regression of the form $$\log\left(Y\right)=x_0 + \left(\frac{x_1}{Y}\right)\beta_1+\log (x_2)\beta_2 + \epsilon$$ I have one covariate as $\left(\frac{x_1}{Y}\right)$ which is a ...
172 views

### How to interpret my coefficients?

I have the following model: $$Gini_{it} = \alpha_i + \beta_1\ln(BNP_{it}) + \beta_2trade_{it} + \epsilon_{it},$$ where $Gini_{it}$ is the Gini-index from 0 to 100, $\ln(BNP_{it})$ is $\ln$ of the ...