2
$\begingroup$

I am fitting a VAR model on 50+ timeseries that both have two variables, x and y. I am trying to identify if my bivariate VAR model has sufficient amount of lags. AIC nad SBIC both suggest using 2 lags. However, when I run Box-Pierce test on the residuals of VAR, the null hypothesis of white noise is rejected in over 50% of the cases (at 5% level of significance). What is even more interesting to me, however, is that as I tried estimating my model with more lags, Box-Pierce Q test rejects even more observations.

I have never ran across a similar problem, and thus I am at loss of how should I proceed. As further background information, both timeseries are over 10,000 periods long. All timeseries are stationary according to ADF, but they have large outliers.

$\endgroup$
3
  • $\begingroup$ First you say 50+ time series, then both time series. So do you have 50+ data sets and consider modelling one of them in this question (and hence both refers to the two time series in this particular data set)? $\endgroup$ Commented Apr 13, 2016 at 19:36
  • $\begingroup$ I have 50+ observations, and for each I have two variables, x and y. Both refers to xi and yi, where i=1, 2,...,50+. There are theoretical reasons to believe that all observations should follow a relatively similar process, and hence I want to fit a VAR model that best describes all 50+ observations. Thank you for the clarification! $\endgroup$
    – Ana
    Commented Apr 13, 2016 at 21:26
  • $\begingroup$ So is it not the way I wrote in the previous comment? Also, where does the number 10,000 come from? $\endgroup$ Commented Apr 14, 2016 at 5:06

1 Answer 1

3
$\begingroup$

AIC and BIC do not target minimizing the amount of autocorrelation in model residuals. Therefore, it is generally not surprising that a model selected by AIC or BIC has some autocorrelation.

The idea behind AIC and BIC is to select a model that describes the data quite well but not "too well", given the limited sample size. Trying to remove all autocorrelations may seem desirable, but if that increases model complexity to a large extent, then we may be overfitting. That is, in-sample results produced by a complicated model may look nice but once we collect more data, we will see that the model as estimated in the initial sample does not fit the new data well. In other words, the model does not generalize well. And we want it to generalize well because we are generally interested in the properties of the population and/or the yet unobserved samples from it. What AIC and BIC do is prevent overfitting and select a "golden middle" (in a certain sense, which differs for AIC and BIC).

Regarding the series being very long (over 10,000 obs.), you will get statistically significant results even when the effect size is very small. Which brings us to the question, are the autocorrelations economically significant? Or are they really tiny from an economic perspective but still statistically significant due to the large sample?

Regarding outliers, something should better be done about them, as otherwise they will be negatively affecting the modelling results. How to handle outliers is a whole separate topic, so I will not attempt to elaborate on that here; but I suggest taking some measures to deal with the outliers instead of neglecting them.

$\endgroup$
2
  • $\begingroup$ Thank you for the detailed answer! I am still a little bit surprised by the Q-test results when increasing lags. What could result to the Q-test rejecting the null hypothesis more often when estimating the model using more lags? $\endgroup$
    – Ana
    Commented Apr 13, 2016 at 23:08
  • $\begingroup$ Since Q test considers all autocorrelations up to the specified lag together, there may be a lot of individually significant autocorrelations at higher order lags so that together they are also significant. $\endgroup$ Commented Apr 14, 2016 at 5:08

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.