The data I have are a regression slope value of y~time, a standard error, an n value and a p value, for a particular species in two different areas. I want to check whether the the regression slope for one area is significantly different from the regression slope for the other area - is this possible with such data? Does anyone have any suggestions how I could go about this? I can't get access to the raw data unfortunately...

Sorry that this is such a simple question!

up vote 15 down vote accepted

The following article might be helpfull to you, as it describes how to evaluate if the effect of a given explanatory factor is invariant over persons, time, or organizations:

Paternoster, R., Brame, R., Mazerolle, P., & Piquero, A. R. (1998). Using the Correct Statistical Test for the Equality of Regression Coefficients. Criminology, 36(4), 859–866.

What they basically say is, that to test the hypothesis that the difference between $b_1$ and $b_2$ (1 and 2 being two samples or times) is equal to zero you can apply the following formula:

$\begin{equation} Z= \frac{b_1-b_2}{\sqrt{{SEb_1}^{2}+{SEb_2}^2}} \end{equation}$

SE being the standard error of the respective 'slopes' in your case.

  • 2
    Kwanti, could you please summarize what this article says? – whuber Apr 9 '13 at 18:16
  • 1
    The article is open access here: udel.edu/soc/faculty/parker/SOCI836_S08_files/… – Sarah Apr 10 '13 at 15:25
  • 3
    That citation is fine but seems really targeted on a discipline that had lost its way. I think I'd prefer Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, New Jersey: Lawrence Erlbaum Associates, Publishers. page 46-47 which gives you a confidence interval which gives you the standard error calculation from which it is a hop skip and a jump to the Z statistic in the above cited paper. – russellpierce Jul 7 '13 at 1:44
  • 1
    @rpierce: Maybe you can post the details of what your talking about in a separate answer, for those of us without access to that book? – naught101 Feb 27 '15 at 3:44
  • 2
    @naught101 the calculation turns out to be the same. I was only stating an opinion that Cohen et al. is a more authoritative source. – russellpierce Feb 27 '15 at 4:08

If the slopes come from ordinary least squares regression, it would be good to verify that the year-to-year data which generated these values are indeed independent. Most capture-recapture studies need to account for previous years' volumes using some method of handling the dependence of volume over time.

Using standard errors, you can construct confidence intervals around your slope parameters. A naive test for whether they are different at the correct $\alpha$ level is to inspect whether any of the confidence intervals overlap. (Note the confidence interval from one parameter has to overlap the other actual parameter value, not its confidence interval, in order to fail to reject the null hypothesis that they're different).

  • Thanks AdamO. I have the standard errors already so I could calculate confidence intervals directly from these... Thanks for the tip... – Sarah Apr 8 '13 at 18:21
  • 1
    I missed that. I'll correct my answer to get rid of tedious algebra. – AdamO Apr 8 '13 at 18:22
  • I believe encouraging such a test based on visual inspection is a bad idea. As well, I don't think the stated overlap criteria are very good. Granted you did say 'naive.' The mean and variance are known; how about a z-test? – ndoogan Apr 8 '13 at 18:42
  • 1
    That is not a test based on visual inspection. Tests based on the overlap of 95% confidence intervals are equivalent to the Wald test which is consistent and unbiased. It conveniently can also be depicted graphically with a forest plot of 95% confidence intervals. Otherwise, there are no multiple testing issues introduced by this test (a usual consequence of exploratory analyses using excessive plots). – AdamO Apr 8 '13 at 20:22
  • Hello, thank you all for your comments. I have finally managed to get hold of the raw data, so this should simplify things! – Sarah Apr 9 '13 at 16:12

The classic (and more statistically powerful) way of testing this is to combine both datasets into a single regression model and then include the area as an interaction term. See, for example, here:

http://www.theanalysisfactor.com/compare-regression-coefficients/

  • 5
    This is "more ... powerful" only if more restrictive assumptions apply. In particular, it assumes homoscedasticity of error variances. Often one would not want to assume that (without additional justification) and therefore would use something like the Welch or Satterthwaite t-test. – whuber Mar 30 '16 at 21:46

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.