Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

I have a time series and want to use AIC / BIC to decide which of the following model is most appropriate:

  • A) AR(1), no constant with Gaussian innovation term
  • B) AR(2), no constant with Gaussian innovation term
  • C) AR(1), no constant with Student t innovation term
  • D) AR(2), no constant with Student t innovation term

What is the correct number of parameters to use in AIC / BIC for the models above?

I found in the Matlab doc the following explanation for an ARMA(p,q) model with Gaussian distribution: "Calculate the BIC for each fitted model. The number of parameters in a model is p + q + 1 (for the AR and MA coefficients, and constant term)."

What I do not understand is why there is no parameter added for the variance of the Gaussian distribution which is also estimated. In particular if the innovation term is Student-t distributed, I assume that the additional 'degree of freedom' parameter of the student t-distribution needs to be considered in AIC / BIC?

I intuitively would have chosen a number of parameters of 2 for A, 3 for B, 3 for C and 4 for D, but it may also be 1 for A, 2 for B, 2 for C and 3 for D if the variance is not counted as parameter (as in the Matlab example).

share|improve this question

2 Answers 2

up vote 1 down vote accepted

For AIC/BIC selection it doesn't really matter whether you choose to count the variance parameter, as long as you are consistent across models, because inference based on information-theoretic criteria only depends on the differences between the values for different models. Thus, adding 2 (for an additional parameter) across the board doesn't change any of the delta-*IC values, which is all you are using to choose models (or do model averaging, compute model weights, etc. etc.).

(However, you do have to be careful if you're going to compare models fitted with different procedures or different software packages, because they may count parameters in different ways.)

It does matter if you are going to use AICc or some other finite-size-corrected criterion, because then the residual information in the data set is used (the denominator of the correction term is $n-k-1$). Then the question you have to ask is whether a nuisance parameter such as the residual variance, which can be computed from the residuals without modifying the estimation procedure, should be included. I wrote in this r-sig-mixed-models post that I'm not sure about the right procedure here. However, looking quickly at Hurvich and Tsai's original paper (Hurvich, Clifford M., and Chih-Ling Tsai. 1989. “Regression and Time Series Model Selection in Small Samples.” Biometrika 76 (2) (June 1): 297–307, doi:10.1093/biomet/76.2.297, http://biomet.oxfordjournals.org/content/76/2/297.abstract), it does appear that they include the variance parameter, i.e. they use $k=m+1$ for a linear model with $m$ linear coefficients ...

I would further quote Press et al. (Numerical Recipes in C) that:

We might also comment that if the difference between $N$ and $N-1$ ever matters to you, then you are probably up to no good anyway - e.g. trying to substantiate a questionable hypothesis with marginal data.

(They are discussing the bias correction term in the sample variance calculation, but the principle applies here as well.)

share|improve this answer

To obtain the AIC or BIC criteria in ARMA models, you need to find the number of estimated parameters in the model (except for the residual variance) including the constant term if it is estimated as mentioned in "Time Series Analysis and Forecasting by Example", by Søren Bisgaard, Murat Kulahci, page 164. So the number of estimated parameters in ARMA(p,q) that contains an intercept or constant term is $p+q+1$ and $p+q$ when you don't have an intercept. See for example Section 6.5 in "Time Series Analysis: With Applications in R" by Jonathan D. Cryer, Kung-Sik Chan.

share|improve this answer
    
+1 for references, although it doesn't really answer the "why?" question posed by the OP. –  Ben Bolker Dec 25 '13 at 17:15

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.