2
$\begingroup$

I have an econometric dataset, 50 observations of 350 variables. They include things like GDP, unemployment, interest rates and their transformation such as YoY change, log transform, first differences etc. I need to build an arimax model, and first I need to select variables.

350 univariate regressions against the response were run, and the 20 best predictor variables based on R-square were chosen.

My question is: is univariate regression a good way to screen predictor variables? I have read that variables perform differently in the when combined with others than alone. Is there anything I need to check about my data before pruning my set of predictor variables this way? ( My response variable is a log return (whose mean is close to zero), the transformed predictor variables vary in scale: some in log scale , others range in 100,000s. I expect most of the transformed ones to be stationary. )

Also, I tried running a Lasso selection in SAS with all the variables, and Lasso terminated in just 1 step selecting one variable only. There was a message whichi said that only 5 records out of the 50 observations were used by Lasso. Could this be due to missing values? My data doesn't have too many missings, so I was surprised. Maybe its because there are far many more predictors than observations (350 vs 50 ).

Thanks for any advice on how to proceed.

$\endgroup$
  • $\begingroup$ maybe you can look at this: scholar.google.co.uk/… $\endgroup$ – TPArrow Aug 5 '15 at 16:37
  • $\begingroup$ and here is the corresponding R package dl.dropboxusercontent.com/u/14629640/… $\endgroup$ – TPArrow Aug 5 '15 at 17:30
  • $\begingroup$ @Hamed, would you mind taking a look at this question? It seems related to the linked research paper. $\endgroup$ – Richard Hardy Aug 6 '15 at 11:26
  • $\begingroup$ 350 univariate regressions against the response were run, and the 20 best predictor variables based on R-square were chosen. No, that does not sound sensible. Examining bivariate relationships is not enough to decide which explanatory variables are the most relevant. LASSO is much more suitable (as long as you deal with the error SAS is giving there). However, there remains the problem that some variables may have delayed response, as mentioned by @IrishStat. Perhaps try LASSO on the variables and their first and second lags (including more lags would perhaps be an overkill)? $\endgroup$ – Richard Hardy Aug 6 '15 at 11:33
  • $\begingroup$ Thanks for the answers. As I mentioned, Lasso only uses 5 out of the 52 records. I don't have that may missing values...so I'm confused. I am actually getting apparently good p-values with the models I built using the method above... but are these p-values suspect in any way? These models are to be used for prediction purposes primarily. I have also posted here on this problem.stats.stackexchange.com/questions/164999/… $\endgroup$ – user2450223 Aug 6 '15 at 16:21
0
$\begingroup$

Your approach fails to consider various forms of delayed response to one or more of the candidate predictors. When determining the appropriate sub-set of variables you need to pre-whiten the variables and form impulse response weights to identify important lags of each of the candidates while taking into account possible variables like pulses/level shifts etc.. We refer to this problem as kitchen-sink modelling as you are throwing everything into the mix except the kitchen sink.

$\endgroup$
  • $\begingroup$ Thanks for your reply. I am new to time series modeling and not sure what a delayed response is... do you mean the lags of the predictor variables? I added a variable clustering step too to finalize the variable selection. I have posted here too about this problem stats.stackexchange.com/questions/164999/… $\endgroup$ – user2450223 Aug 6 '15 at 16:33
  • $\begingroup$ Yes that is what i mean. Consider candidate X having a 3 period lag effect on Y. Your scheme would not necessarily identify candidate X . $\endgroup$ – IrishStat Aug 6 '15 at 18:27
  • $\begingroup$ The original 350 include lags as well as other transformationso of the raw variables. Could you suggest any other ways to choose features for this problem? Thanks $\endgroup$ – user2450223 Aug 7 '15 at 1:16
  • $\begingroup$ What you are trying to do is to perform a list based solution by preparing (in advance) various transformations. A better approach ( which is what I programmed in AUTOBOX) is to take each distinct (original candidate) X variable and to assess it's importance to predict/model the Y variable taking into account potential contemporary and lag effects while incorporating any Gaussian violations such as pulses/level shifts/seasonal pulses and/or local time trends. Then rank these predictors and then select an estimable subset based upon the length of your data. $\endgroup$ – IrishStat Aug 7 '15 at 11:28

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.