ARMA model selection involves selecting a number of autoregressive lags and moving average lags. Meaningfully estimating the coefficients (i.e. without overfitting) requires the length of the series to be far greater than the number of parameters. If the series is quite short, say 10 time points, then a model that considers all 10 lags to predict the next observation is out of the question (let's ignore Bayesian approaches for the moment).

However, suppose that instead of a single series I have 1000 series, and suppose that each of these is generated independently but from the same underlying random process. If all I care about are the AR coefficients, I could fit a linear regression of the final observation on all of the previous ones -- each series is a single row of a linear model design matrix -- right? Is there a standard algorithm/software that similarly extends the fitting process for the MA terms to incorporate multiple series?

  • 4
    $\begingroup$ In one of the earlier posts, Rob J. Hyndman suggested a trick how to do this for ARMA: concatenate all of your series into one but put a lot of NAs in between. Then fit an ARMA model. I will try to find the relevant thread. $\endgroup$ – Richard Hardy Mar 26 '17 at 8:30
  • $\begingroup$ Burried deep, cannot find it. But this is a duplicate, it is just a matter of finding the other thread. $\endgroup$ – Richard Hardy Mar 26 '17 at 8:38
  • $\begingroup$ That is insightful. I'll have to learn more details of the ARMA fitting algorithm to understand if usual model selection heuristics apply. $\endgroup$ – zkurtz Mar 26 '17 at 11:05
  • $\begingroup$ stats.stackexchange.com/a/23123/159 $\endgroup$ – Rob Hyndman Mar 26 '17 at 20:16

Browse other questions tagged or ask your own question.