Dear Cross Validated Community

I have a question about handling dependencies in time-series regression. This is not an urgent issue. However, it would be nice to have a little discussion here - if someone is intereste in this topic and has time to answer.

Here is the situation: I have land surface temperature (LST) and NDVI data for a 600x600 pixel scene (it does not matter what NDVI is; for an explanation, see [1]). This datasets spans 15 years, one observation every 16th day. Further, I have a classification dataset that shows different types of vegetation, like 'forest', 'crop', 'grassland' etc.

From the NDVI time series, I extracted phenological metrics for every pixel and every year: Start of Season (SoS), End of Season (EoS) and Length of Season (LoS) (See [2] for more detailed information). Let's talk only about SoS, to simplify the problem.

The SoS should not be autocorrelated for the respective pixels, there is only one value per year, but there might be a trend. Now, I want to do a linear regression for every pixel where the dependent variable is the SoS and the independent variable is the LST at the same pixel. Obviousely, the SoS is not only dependent on the LST at the day of year (t), but also on previous values (t-1, t-2, ...).

My idea: Investigate the dependencies for the whole dataset to derive a 'global rule'.

  • Let $SOS(p_{i}, s_j)$ be a vector containing the SoS of pixel $p_i$ and season $s_j$.
  • $B$ is a vector containing the coefficients of the regression
  • $LST$ is a matrix containing $LST(p_i, s_j, t_k)$, the LST at a pixel $p_i$, season $s_j$ and time $t_{0-k}$:

Estimating $B$ for time lags $t$, $t-1$,...,$t-k$:

$$\begin{pmatrix} SoS(p_1, s_1)\\ SoS(p_1, s_2)\\ ...\\ SoS(p_n, s_m) \end{pmatrix} = \begin{pmatrix} 1 \ \ \ LST(p_1, s_1, t_0) \ \ \ LST(p_1, s_1, t_{-1}) \ \ \ ...\\ 1 \ \ \ LST(p_1, s_2, t_0) \ \ \ LST(p_1, s_2, t_{-1}) \ \ \ ...\\ ...\\ 1 \ \ \ LST(p_n, s_m, t_0) \ \ \ LST(p_n, s_m, t_{-1}) \ \ ... \end{pmatrix} \begin{pmatrix} B_{0}\\ B_{t}\\ ...\\ B_{t-k} \end{pmatrix}$$

I didn't try this yet. If there is no significance at any time lag, I could convert the model to a mixed effects model, such that the intercept follows a gaussian distribution. Or I could even go further and include the vegetation type as factor, because the dependency on the LST could be different for different vegetation types (I somehow have the feeling that I'm not taking into account the autocorrelation of the LST).

Once I know until which time lag $l$ the dependency is significant, I can use this knowledge to do a regression for every point, where the independent variable is $$LST^* = B_tLST_t+B_{t-1}LST_{t-1}+...+B_{t-l}LST_{t-l}$$


This smells like a time series problem, but I'm dealing with it in a classic regression mindset... The SoS is static for a certain pixel and season, maybe that's why i'm confused.

  • Does this make ANY sense at all?
  • Is there an easyer way to deal with such problems?
  • What do you think in general about this approach?

I know, this is a lot of text. I would also be happy if someone could give me a keyword to look it up myself.

Cheers, Basil

[1] Normalized Difference Vegetation Index (NDVI) it is a proxy for vegetation activity or 'greenness'. The index is usually built from remote sensing data (satellites, airplanes), including the RED and the NIR band, where RED is the wavelength of red light (about 660nm) and NIR is the near infrared wavelength (abut 800nm). NDVI = (NIR-RED)/(NIR+RED). The NDVI shows a strong seasonality.

[2] The values indicate the day of year of the respective event, or the length from SoS to EoS in the case of LoS. They were derived by smoothing the time series and extracting the day of year at the 50% treshold for each year and each pixel.

  • 1
    $\begingroup$ To take into account the LST autocorrelation, I would first try an AR or ARMA model to explain the LST itself. This will leave you with a timeseries of the "innovative" component at each time interval which you can use as an independent variable. I'm pretty new to this field myself so it's just my intuition speaking. $\endgroup$ – KishKash Mar 17 '15 at 20:58
  • $\begingroup$ I thought about this, too. But my thoughts ended in the following: Let's say the LST is an ARMA(p, q) process. From the data, we estimate p and q - after seasonality and trend removal. Now, we have modelled the LST. But how is that related to the SoS? The SoS might depend on a longer or shorter period. Let's say the LST could be modelled with an AR(1) process (that's very unlikely), but the SoS depends on the past 30 days, where the individual days have a different weight, how would the AR(1) model help us? $\endgroup$ – bask0 Mar 17 '15 at 21:38
  • 1
    $\begingroup$ The AR(1) would help because you're feeding a more concise representation of the LST as the independent variable. The SoS may still have an elaborate dependence on more- or less-recent history, but you will relate it to the unexpected component of history, avoiding "double-counting" components in recent history which were already expected given previous measurements. $\endgroup$ – KishKash Mar 18 '15 at 7:56

Ordinary Least Squares estimation is inadequate in the existence of heteroscedasticity- unequal and out-of-diagonal covariance terms among the observations.

In your example, LST is a time-series which you assume to have autoregressive nature. Therefore, when using successive terms from this time series as regressors, you should be aware the OLS may be inefficient and yield over-optimistic error estimates. Two methods that address these issues are:

  1. Generalized Least Squares - This approach employs the observation correlation matrix (or in most practical cases, an estimate of the correlation matrix) and can be intuitively explained as equivalent to performing the regression in a transformed vector space where the observations are uncorrelated.

  2. OLS with robust variance estimation - With this approach, the regression coefficients (B in your example) are calculated the same way as with OLS, but the error terms' variance is estimated in any of the available techniques that make the estimation more robust to the existence of correlations and unequal variances.

Googling "Generalized least squares" or "robust variance estimation" should get you useful resources. In addition, see Gretl User's Guide, chapter 17.

| cite | improve this answer | |
  • $\begingroup$ It happens that I did the regression just a few minutes before, and you are right: The LST data is highly correlated and I get a useless result using OLS. I'll follow your suggestion and use GLS. Thanks KishKash! $\endgroup$ – bask0 Apr 15 '15 at 15:07

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.