20
$\begingroup$

The data I have are a regression slope value of y~time, a standard error, an n value and a p value, for a particular species in two different areas. I want to check whether the the regression slope for one area is significantly different from the regression slope for the other area - is this possible with such data? Does anyone have any suggestions how I could go about this? I can't get access to the raw data unfortunately...

Sorry that this is such a simple question!

Improve this question
$\endgroup$
1
18
$\begingroup$

The following article might be helpfull to you, as it describes how to evaluate if the effect of a given explanatory factor is invariant over persons, time, or organizations:

Paternoster, R., Brame, R., Mazerolle, P., & Piquero, A. R. (1998). Using the Correct Statistical Test for the Equality of Regression Coefficients. Criminology, 36(4), 859–866.

What they basically say is, that to test the hypothesis that the difference between $b_1$ and $b_2$ (1 and 2 being two samples or times) is equal to zero you can apply the following formula:

$\begin{equation} Z= \frac{b_1-b_2}{\sqrt{{SEb_1}^{2}+{SEb_2}^2}} \end{equation}$

SE being the standard error of the respective 'slopes' in your case.

Improve this answer
$\endgroup$
13
  • 2
    $\begingroup$ Kwanti, could you please summarize what this article says? $\endgroup$
    – whuber ♦
    Apr 9 '13 at 18:16
  • 1
    $\begingroup$ The article is open access here: udel.edu/soc/faculty/parker/SOCI836_S08_files/… $\endgroup$
    – Sarah
    Apr 10 '13 at 15:25
  • 5
    $\begingroup$ That citation is fine but seems really targeted on a discipline that had lost its way. I think I'd prefer Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, New Jersey: Lawrence Erlbaum Associates, Publishers. page 46-47 which gives you a confidence interval which gives you the standard error calculation from which it is a hop skip and a jump to the Z statistic in the above cited paper. $\endgroup$
    – russellpierce
    Jul 7 '13 at 1:44
  • 1
    $\begingroup$ @rpierce: Maybe you can post the details of what your talking about in a separate answer, for those of us without access to that book? $\endgroup$
    – naught101
    Feb 27 '15 at 3:44
  • 2
    $\begingroup$ @naught101 the calculation turns out to be the same. I was only stating an opinion that Cohen et al. is a more authoritative source. $\endgroup$
    – russellpierce
    Feb 27 '15 at 4:08
5
$\begingroup$

If the slopes come from ordinary least squares regression, it would be good to verify that the year-to-year data which generated these values are indeed independent. Most capture-recapture studies need to account for previous years' volumes using some method of handling the dependence of volume over time.

Using standard errors, you can construct confidence intervals around your slope parameters. A naive test for whether they are different at the correct $\alpha$ level is to inspect whether any of the confidence intervals overlap. (Note the confidence interval from one parameter has to overlap the other actual parameter value, not its confidence interval, in order to fail to reject the null hypothesis that they're different).

Improve this answer
$\endgroup$
5
  • $\begingroup$ Thanks AdamO. I have the standard errors already so I could calculate confidence intervals directly from these... Thanks for the tip... $\endgroup$
    – Sarah
    Apr 8 '13 at 18:21
  • 1
    $\begingroup$ I missed that. I'll correct my answer to get rid of tedious algebra. $\endgroup$
    – AdamO
    Apr 8 '13 at 18:22
  • $\begingroup$ I believe encouraging such a test based on visual inspection is a bad idea. As well, I don't think the stated overlap criteria are very good. Granted you did say 'naive.' The mean and variance are known; how about a z-test? $\endgroup$
    – ndoogan
    Apr 8 '13 at 18:42
  • 1
    $\begingroup$ That is not a test based on visual inspection. Tests based on the overlap of 95% confidence intervals are equivalent to the Wald test which is consistent and unbiased. It conveniently can also be depicted graphically with a forest plot of 95% confidence intervals. Otherwise, there are no multiple testing issues introduced by this test (a usual consequence of exploratory analyses using excessive plots). $\endgroup$
    – AdamO
    Apr 8 '13 at 20:22
  • $\begingroup$ Hello, thank you all for your comments. I have finally managed to get hold of the raw data, so this should simplify things! $\endgroup$
    – Sarah
    Apr 9 '13 at 16:12
2
$\begingroup$

The classic (and more statistically powerful) way of testing this is to combine both datasets into a single regression model and then include the area as an interaction term. See, for example, here:

http://www.theanalysisfactor.com/compare-regression-coefficients/

Improve this answer
$\endgroup$
2
  • 6
    $\begingroup$ This is "more ... powerful" only if more restrictive assumptions apply. In particular, it assumes homoscedasticity of error variances. Often one would not want to assume that (without additional justification) and therefore would use something like the Welch or Satterthwaite t-test. $\endgroup$
    – whuber ♦
    Mar 30 '16 at 21:46
  • $\begingroup$ In response to a11msp: What if all your variables are continuous? Can you still use the interaction term to answer this question? $\endgroup$
    – M BG
    May 13 '20 at 21:53

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.