15
$\begingroup$

I have a multivariate regression, which includes interactions. For example, to get the estimate of the treatment effect for the poorest quintile I need to add the coefficients from the treatment regressor to the coefficient from the interaction variable (which interacts treatment and quintile 1). When adding two coefficients from a regression, how does one obtain standard errors? Is it possible to add the standard errors from the two coefficients? What about the t-stats? Is it possible to add these as well? I'm guessing not but I can't find any guidance on this.

Thanks so much in advance for your help!

$\endgroup$
2
  • $\begingroup$ this is really helpful! I am looking to do something similar in R, but I have slightly different sample sizes between groups. Can I still use the same equation to combine the two errors to give me the new Std. error? Thank you in advance for any help Crystal $\endgroup$
    – Crystal
    Commented Jan 24, 2012 at 16:18
  • 2
    $\begingroup$ Hey @Crystal - welcome to the site! This is a good question, but you should pose it as a new question (the "Ask Question" button on the top right). Right now, you've submitted it as an "answer" to this old question. If you just copy and paste the URL of this question into your new question, we'll all understand what you're talking about. $\endgroup$ Commented Jan 24, 2012 at 16:34

3 Answers 3

10
$\begingroup$

I think this the expression for $SE_{b_{new}}$:

$$\sqrt{SE_1^2 + SE_2^2+2Cov(b_1,b_2)}$$

You can work with this new standard error to find your new test statistic for testing $H_o: \beta=0$

$\endgroup$
3
  • $\begingroup$ Hello Sarah, you should close this question if you think it is answered. $\endgroup$
    – suncoolsu
    Commented Oct 16, 2010 at 21:14
  • $\begingroup$ Hi - Thanks again for your answer. I forgot to mention that I am using Stata. When I add two coefficients together (using the output from Stata), can I also just add the standard errors? If so, then I should be able to obtain the standard errors by dividing the sum of the coefficients by the sum of the standard errors. Do you agree? Thanks again. $\endgroup$
    – Sarah
    Commented Oct 18, 2010 at 15:13
  • $\begingroup$ Sarah, In Stata, use the 'lincom' function. Suppose you have variables var1 and var2 and want to add 3 times the coefficient on var1 and 2 times the coefficient on var2. Type 'lincom 3 * var1 + 2 * var2'. This gives the standard error and confidence interval for this estimate. $\endgroup$
    – Charlie
    Commented Oct 18, 2010 at 15:42
5
$\begingroup$

I assume you mean 'multivariable' regression, not 'multivariate'. 'Multivariate' refers to having multiple dependent variables.

It is not considered to be acceptable statistical practice to take a continuous predictor and to chop it up into intervals. This will result in residual confounding and will make interactions misleadingly significant as some interactions can just reflect lack of fit (here, underfitting) of some of the main effects. There is a lot of unexplained variation within the outer quintiles. Plus, it is actually impossible to precisely interpret the "quintile effects."

For comparisons of interest, it is easiest to envision them as differences in predicted values. Here is an example using the R rms package.

require(rms)
f <- ols(y ~ x1 + rcs(x2,3)*treat)  # or lrm, cph, psm, Rq, Gls, Glm, ...
# This model allows nonlinearity in x2 and interaction between x2 and treat.
# x2 is modeled as two separate restricted cubic spline functions with 3
# knots or join points in common (one function for the reference treatment
# and one function for the difference in curves between the 2 treatments)
contrast(f, list(treat='B', x2=c(.2, .4)),
            list(treat='A', x2=c(.2, .4)))
# Provides a comparison of treatments at 2 values of x2
anova(f) # provides 2 d.f. interaction test and test of whether treatment
# is effective at ANY value of x2 (combined treat main effect + treat x x2
# interaction - this has 3 d.f. here)
$\endgroup$
2
$\begingroup$

To be more general, if you create a (row) vector for the estimate that you care about $R$ such that your estimator is equal to $R\beta$, then the variance of that estimator is $R\hat{V}R^\prime$, where $\hat{V}$ is the estimated variance-covariance matrix of your regression. Your estimate is distributed Normal or t, depending upon the assumption that you are making (Law of Large Numbers v. assuming normal errors in your regression model). Alternatively, you can test multiple estimates if you let $R$ be a matrix. This is known as a Wald test. The distribution in this case is a $\chi^2_r$, where $r$ is the number of rows in your matrix (assuming that the rows are linearly independent).

$\endgroup$
1
  • $\begingroup$ Thanks. I will pose another question as I am not a stats expert and am not sure my question was clear. $\endgroup$
    – Sarah
    Commented Oct 18, 2010 at 14:11

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.