Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

One way to calculate importance of a variable in a regression, is to get the decrease in $RSS$ when we calculate a model without the variable in question.

Is this valid for a regression with ARIMA errors?

Suppose I want to get three measures:

  1. Importance of external regressor
  2. Importance of ARIMA coefs
  3. Importance of Seasonal ARIMA coefs

Would the decrease in $RSS$ if I compare the original $RSS$ with the $RSS$ the following models represent the measures I list above?

  1. $ARIMA(p,d,q)(P,D,Q)$ without external regressor
  2. $ARIMA(0,0,0)(P,D,Q)$ with external regressor
  3. $ARIMA(p,d,q)(0,0,0)$ with external regressor
share|improve this question
I realize this is a little late, but how are you selecting the ARIMA parameters? Obviously, if, for example, $(p,d,q)$ in model 1 is different from $(p,d,q)$ in the original model there will be some confounding of the effect of the external regressor with the change in $(p,d,q)$. – jbowman Jun 10 '12 at 17:45

1 Answer

What you want to do is to express your model as a pure right-hand side model where the right hand side contains lags of the output series and the contemporaneous and lag effects of each of the input regressors and a possible constant. Simply add up the effects to be able to partition the forecast into these separate factors. I have programmed this task in a commercially available piece of software I am involved with. If you need help in programming this I would be glad to help you.

Additional comments: In my opinion it makes no sense breakout the effect of ARIMA vs SARIMA as the combination of them is synergistic reflecting unspecified stochastic series. The way I would approach the problem is to build a transfer function including any needed lag structure for the known X's and include any necessary deterministic structure identfied via Intervention Detection AND set the error process to be white noise i.e. no ar or ma structure at all. As a second step I would ignore the external regressors and incorprate both any necessary deterministic structure identfied via Intervention Detection AND a suitable ar and ma process reflecting ARIMA and SARIMA. The difference in RSS should be based upon a fixed number of fitted points as the incorporation of ar and ma structure often changes the degrees of freedom.

share|improve this answer
Actually I don't want to partition the forecast into different factors. What I want is to generate three models (each one with different inferences for the coefficients), in order to compare their RSS. I'm a freshman with ARIMA models, and didn't understand how to use what you said to do this. – João Daniel May 14 '12 at 17:21

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.