Let’s consider some common linear time series models for which OLS does not usually yield unbiased coefficient estimates. These include ARIMA and ARIMAX models, regression models with ARIMA errors, autoregressive distributed lag (ARDL) models, and dynamic models, i.e. including a lagged dependent variable on the right hand side, with or without lagged independent variables, where the error is autocorrelated even after including a lagged dependent variable.
Suppose you have estimated coefficients for such a model in an appropriate fashion. If you want to regularize this models to prevent over-fitting, say with LASSO or ridge regression, is it appropriate to treat the RHS variables as if they were all independent and estimate the tuning parameter via cross-validation in the standard way? Or do each of these models require an individual, specialized form of regularization?