10
$\begingroup$

I am plotting a residual plot to test for heteroskedasticity. The Breusch-Pagan test is significant and therefore I am suspecting there is evidence on heteroskedasticity. The question is:

(a) How can I interpret such graph? I know some points seem to be on top of each other etc. is it as simple as that?

(b) Also the data has a lot of binary dummy variables. Could this be the reason for heteroskedasticity?

Residual plot

$\endgroup$
7
  • 3
    $\begingroup$ Cesare, I think you're confusing homo- with heteroscedasticity. $\endgroup$ Aug 29, 2013 at 20:00
  • 3
    $\begingroup$ The effect of the dummies is to make the residuals tend to form vertical lines: this is especially apparent for the lowest fitted values. The graph is somewhat inadequate in that each point may represent multiple coincident values, but it does indeed show some tendency towards less vertical scatter at the highest fitted values (but not by a lot: that appearance is due partly to the fact there are fewer residuals at the higher values). Yet what you do about this--if anything--depends on the nature of the data and what you are trying to learn. Perhaps you could share some information about that? $\endgroup$
    – whuber
    Aug 29, 2013 at 20:04
  • $\begingroup$ I am trying to learn the effect of these binary dummies on investment. The only continuous independent variable is age, all the rest are binary variables or additive dummies. Yes :I meant heteroscedasticity. $\endgroup$ Aug 29, 2013 at 22:37
  • 2
    $\begingroup$ At a guess you used rvfplot in Stata for this graph. You can get an idea of overplotting by using options ms(oh) jitter(1). $\endgroup$
    – Nick Cox
    Aug 29, 2013 at 22:56
  • 2
    $\begingroup$ @whuber summarized well, as usual. This graph alone would not make me think my model was quite wrong. Stata comment: rvfplot2 has more flexibility than rvfplot, but you need to install it. Use search rvfplot2 and use the latest version from the Stata Journal. $\endgroup$
    – Nick Cox
    Aug 31, 2013 at 8:59

2 Answers 2

9
$\begingroup$

Concerning heteroscedasticity, you are interested in understanding how the vertical spread of the points varies with the fitted values. To do this, you must slice the plot into thin vertical sections, find the central elevation (y-value) in each section, evaluate the spread around that central value, then connect everything up. Here are some possible slices:

Figure 1: Original graphic with vertical slices superimposed

Ordinarily this would be done using robust estimates of location and spread, such as a median and interquartile range. If we had the data, we might generate a wandering schematic plot. Data are difficult to extract numerically from a graphical image with overplotted points. However, in this case the vertical spreads tend to be compact, symmetrical, and without outliers, so we are safe using means and standard deviations instead--and these are easily computed using image processing software. In fact, what I did was to smear the dots horizontally and then compute the mean and variance of their locations for every vertical column of pixels in the image. (This processing will be a little inaccurate due to overplotting of some points, but it's not likely to bias the relative SDs much.)

Figure 2: horizontally smeared plot.

There is a definite wedge shape to the smeared points, narrowing from left to right. (Squinting at a graphic can sometimes help bring out such an overall gestalt impression of a scatterplot, provided it has many points.)

The mean (shown below in blue) and the mean plus or minus a suitable multiple of the square root of the variance (in red and gold) will trace out the location and typical limits of the residuals.

Figure 3: Traces imposed on the original plot.

I chose a multiple designed to place about 5% of the points above the upper trace and another 5% below the lower trace.

With practice you can see such traces by closely examining the plot itself--no calculations are necessary. Scanning across from left to right, estimate the middle of each vertical column of dots. Estimate their spread. Inflate your estimates of spread a little where there are relatively fewer dots--they haven't had a chance to show the full amount of their dispersion. At the same time, discount your estimates (that is, don't give them much credence) in areas where there are very few dots, because your estimates are highly uncertain there.

Look for clear consistent patterns of changes in spread. In the preceding figure, the upper trace (red) and lower trace (gold) appear to draw a little closer together from left to right, as the fitted value increases. This can be made more apparent by plotting the standard deviation. The units don't matter, but the vertical axis should start at zero to give an accurate rendition of relative sizes of the spreads:

Figure 4: Plot of SD against fitted value.

This confirms the initial impression of a decreasing SD with increasing fitted value. Overall, the SD is halved as we scan from left to right. (The slight upward increase at the very right can be discounted since it is associated with few data points.) This is a classic form of heteroscedasticity: the spread changes systematically with the fitted value.


The use of dummy variables in a multiple regression will not introduce heteroscedasticity. Often it will reduce it, by resolving overlapping groups of residuals into separate ones.

Whether heteroscedasticity is actually a problem depends on the purpose of the analysis, the regression method employed, what information is being extracted from the results, and the nature of the data.

$\endgroup$
0
$\begingroup$

There is no doubt that these plots indicate heteroscedasticity. If an exact test needed my recent study will give the respond "A new test to detect monotonic and non-monotonic types of heteroscedasticity, journal of applied statistics, 2016"

$\endgroup$
5
  • 2
    $\begingroup$ Please give a full reference and/or URL. $\endgroup$
    – Nick Cox
    Jun 9, 2016 at 21:50
  • $\begingroup$ tandfonline.com/doi/abs/10.1080/… $\endgroup$ Jun 9, 2016 at 21:54
  • 1
    $\begingroup$ It would be better to add that to your answer using the "edit" button - could you give the reference in the form that you would expect to see in a citation? $\endgroup$
    – Silverfish
    Jun 9, 2016 at 21:58
  • $\begingroup$ the article status is "published online" thats why i just gave the title and doi $\endgroup$ Jun 9, 2016 at 22:01
  • 2
    $\begingroup$ Welcome to the site, @ReşitÇelik. We appreciate your contribution. At present, this should really be a comment (with the link added). Can you expand your answer to give a quick overview of your test? We can also convert this into a comment for you. $\endgroup$ Jun 9, 2016 at 22:48

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.