6
$\begingroup$

I have two questions below:

  1. Could a data point be an influential point if its cook distance is outstanding(greater than 4/(n-p-1)) while its standardised residual is less than 2? It looks like to me , to say a data point is an influential point, its Cook's distance has to be larger than 4/(n-p-1)) AND its standardised residual has to be greater than 2, am I correct?

  2. Sometimes when we delete an influential point, the regression line does't change much then we leave the data point in the model. But why the influential point didn't change the regression line much? According to its large cook's distance, the data point is an influential point, being an influential point means the data point has to change the regression line very much if it is deleted,otherwise it shouldn't be called an influential point, isn't it?

Improve this question
$\endgroup$
1
  • 1
    $\begingroup$ In another thread a related question was asked. However, the present question is different in that it talks strictly about standardized residuals, without getting into a lot of discussion about the various meanings of the term "outlier". $\endgroup$
    – user1205901 - Слава Україні
    Commented May 13, 2016 at 4:20

1 Answer 1

Reset to default
8
$\begingroup$

1. A data point can still be considered influential if it has a large Cook's Distance, even if it has a low standardized residual.

The following image (taken from p214 of Andy Field’s Discovering Statistics Using IBM SPSS 3e) may help to clarify the difference between these two concepts.

enter image description here

The red line depicts the regression model, while the dotted blue line represents the regression model if data point 8 is removed. Note that data point 8 has a very small residual statistic, as it’s very close to the red line. However, it would have a massive influence statistic (according to the textbook, it has a Cook’s distance of 227.14!) since the model changes radically when it is omitted.

2. I don't think it's right to say "Sometimes when we delete an influential point, the regression line does't change much".

If the regression model didn't change much with the omission of the data point, then I don't think it's fair to say that the data point was influential.

Here's Wikipedia's definition of an influential data point:

[I]n regression analysis an influential point is one whose deletion has a large effect on the parameter estimates

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.