42
$\begingroup$

I have two time series, shown in the plot below:

Time Series Plot

The plot is showing the full detail of both time series, but I can easily reduce it to just the coincident observations if needed.

My question is: What statistical methods can I use to assess the differences between the time series?

I know this is a fairly broad and vague question, but I can't seem to find much introductory material on this anywhere. As I can see it, there are two distinct things to assess:

1. Are the values the same?

2. Are the trends the same?

What sort of statistical tests would you suggest looking at to assess these questions? For question 1 I can obviously assess the means of the different datasets and look for significant differences in distributions, but is there a way of doing this that takes into account the time-series nature of the data?

For question 2 - is there something like the Mann-Kendall tests that looks for the similarity between two trends? I could do the Mann-Kendall test for both datasets and compare, but I don't know if that is a valid way to do things, or whether there is a better way?

I'm doing all of this in R, so if tests you suggest have a R package then please let me know.

$\endgroup$
  • 9
    $\begingroup$ The plot appears to obscure what may be a crucial difference between these series: they might be sampled at different frequencies. The black line (Aeronet) seems to be sampled only about 20 times and the red line (Visibility) hundreds of times or more. Another critical factor may be the regularity of sampling, or lack thereof: the times between Aeronet observations appear to vary a little. In general, it helps to erase the connecting lines and display only the points corresponding to actual data, so that the viewer can determine these things visually. $\endgroup$ – whuber Nov 29 '11 at 18:11
  • $\begingroup$ Here is a Python library for unevenly-spaced time series analysis. $\endgroup$ – kjetil b halvorsen Nov 4 '18 at 13:12
27
$\begingroup$

As others have stated, you need to have a common frequency of measurement (i.e. the time between observations). With that in place I would identify a common model that would reasonably describe each series separately. This might be an ARIMA model or a multiply-trended Regression Model with possible Level Shifts or a composite model integrating both memory (ARIMA) and dummy variables. This common model could be estimated globally and separately for each of the two series and then one could construct an F test to test the hypothesis of a common set of parameters.

$\endgroup$
12
$\begingroup$

Consider the grangertest() in the lmtest library.

It is a test to see if one time series is useful in forecasting another.

A couple references to get you started:

https://spia.uga.edu/faculty_pages/monogan/teaching/ts/

https://spia.uga.edu/faculty_pages/monogan/teaching/ts/Kgranger.pdf

http://en.wikipedia.org/wiki/Granger_causality

$\endgroup$
  • 1
    $\begingroup$ His sample size would be too small with < 10 datapoints versus the amount of parameters you need to fit in Granger. $\endgroup$ – Jase Dec 27 '12 at 6:07
  • 1
    $\begingroup$ @fionn, the links in your answer are dead. Can you update your answer? $\endgroup$ – Davor Josipovic Nov 16 '17 at 17:42
0
$\begingroup$

Just came across this. Your first answer us plotting g the two sets the same scale (timewise) to see the differences visually. You have done this and can easily see there are some glaring differences. The next step is to use simple correlation analysis...and see how well are they related using the correlation coefficient (r). If the r is small your conclusion would be that they are weakly related and so no desirable comparisons and a larger value if r would suggest good comparisons s between the two series. The third step where there is good correlation is to test the statistical significance of the r. Here you can use the Shapiro Welch test which would assume the two series are normally distributed (null hypothesis ) or not (alternative hypothesis). There are other tests you can do but let me hope my answer helps.

$\endgroup$
  • $\begingroup$ When comparing time series it is autocorrelation and possibly fitting time series models. such as ARIMA models that can help determine how similar they are. Two realizations of the same stochastic process don't necessarily look the same when plotting them. $\endgroup$ – Michael Chernick Feb 9 at 2:28
-2
$\begingroup$

Fit a straight line to both the time series signals using polyfit. Then compute root-mean-square-error (RMSE) for both the lines. The obtained value for the red-line would be quite less than the one obtained for gray line.

Also make the readings on some common frequency.

$\endgroup$
  • 2
    $\begingroup$ Welcome to Cross Validated and thanks for your first answer! I am however concerned that you are not answering the question directly - how exactly would the proposed approach help the asker to asses whether the values and/or trends are similar? $\endgroup$ – Martin Modrák Mar 12 '18 at 9:49

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.