I'm running a couple of regressions and, as I wanted to be on the safe side, decided to use HAC (heteroskedasticity & autocorrelation consistent) standard errors throughout. There might be a few cases where serial correlation is not present. Is this anyways a valid approach? Are there any drawbacks?
-
1$\begingroup$ if you use HAC, though there is no serial corr., you will be safe, no worries. $\endgroup$– Math-funJul 5, 2016 at 12:33
-
$\begingroup$ Thanks for the fast reply, that's good to hear! Just found this thread here which is related: stats.stackexchange.com/questions/144721/… So its safe to use but there are some losses in efficiency. Thanks again! $\endgroup$– Juliett BravoJul 5, 2016 at 12:49
-
$\begingroup$ related: stats.stackexchange.com/questions/43787/… $\endgroup$– Math-funJul 5, 2016 at 14:17
2 Answers
Loosely, when estimating standard errors:
- If you assume something is true and it isn't true, you generally lose consistency. (This is bad. As the number of observations rises, your estimate need not converge in probability to the true value.) Eg. when you assume observations are independent and they aren't, you can massively understate standard errors.
- If you don't assume something is true and it is true, you generally lose some efficiency (i.e. your estimator is more noisy than necessary.) This often isn't a huge deal. Defending your work in seminar tends to be easier if you've been on the conservative side in your assumptions.
If you have enough data, you should be entirely safe since the estimator is consistent!
As Woolridge points out though in his book Introductory Econometrics (p.247 6th edition) a big drawback can come from small sample issues, that you may be effectively dropping one assumption (i.e. no serial correlation of errors) but adding another assumption that you have enough data for the Central Limit Theorem to kick in! HAC etc... rely on asymptotic arguments.
If you have too little data to rely on asymptotic results:
- The "t-stats" you compute may not follow the t-distribution for small samples. Consequently, the p-values may be quite wrong.
- But if the errors truly are normal, homoskedastic, IID errors then the t-stats you compute, under the classic small sample assumptions, will follow the t-distribution precisely.
See this answer here to a related question: https://stats.stackexchange.com/a/5626/97925
-
$\begingroup$ Please define consistency and efficiency. They have nothing to do with assuming something is true or false in the way you describe. $\endgroup$– user318514Sep 4, 2022 at 11:00
Indeed, there should be some loss in efficiency in finite samples but asymptotically, you are on the safe side. To see this, consider the simple case of estimating a sample mean (which is a special case of a regression in which you only regress on a constant):
HAC estimators estimate the standard error of the sample mean. Suppose $Y_t$ is covariance stationary with $E(Y_t)=\mu$ and $Cov(Y_t,Y_{t-j})=\gamma_j$ such that $\sum_{j=0}^\infty|\gamma_j|<\infty$.
Then, what HAC standard errors estimate is the square root of the "long run variance", given by: $$\lim_{T\to\infty}\{Var[\sqrt{T}(\bar{Y}_T- \mu)]\}=\lim_{T\to\infty}\{TE(\bar{Y}_T- \mu)^2\}=\gamma_0+2\sum_{j=1}^\infty\gamma_j.$$ Now, if the series actually has no serial correlation, then $\gamma_j=0$ for $j>0$, which the HAC estimator will also "discover" as $T\to\infty$, so that it will boil down to an estimator of the square root of the standard variance $\gamma_0$.