Skip to main content
5 of 8
added 1 character in body
benso8
  • 315
  • 1
  • 8

Using the mean for missing values is not ALWAYS a bad thing. In fact, in the the study of econometrics, this is actually a recommended course of action in some cases provided you understand what the consequences may be and in what cases it is helpful. As you have read, replacing missing values with the mean can reduce the variance. Here is what that can cause.

Note that the coefficient of determination, $$R^2 = \frac{SSR}{SSTO} = \frac{\sum (\hat{y_i} - \bar{y})^2}{\sum (y_i - \bar{y})^2}.$$ Assuming you have missing $y$ values and you replace those with the sample mean then you can actually have an $R^2$ value that is not as accurate as having the real data. This is because if you have more variance in the data, that means there is more data that is likely further away from the regression line. Since the $R^2$ value depends on individual actual observed $y$ values (see $y_i$ in $SSTO$), your $R^2$ could be inflated because $SSTO$ will be smaller.

Lets look at an example of what I mean.

Lets say you have a value $x_3$ and the corresponding observation for that $x$ value was $y_3$. We do the calculation for that result for SSTO and we have

$$ (y_3 - \bar{y})^2 $$

and that result gets added to the sum for $SSTO$. Now, instead, let's say that value $y_3$ is missing. We then let the missing $y_3 = \bar{y}$. We then have

$$ (\bar{y} - \bar{y})^2 = 0. $$.

As you can see, when we add this to the other results for the denominator the $SSTO$ sum will be smaller.

benso8
  • 315
  • 1
  • 8