6
$\begingroup$

I have large number of time-series that are independent of each other, but share some seasonality patterns. I need to detect anomalies/changes (increased volume, change in mean), that appear in the individual time-series. I also have some potential explanatory variables, but they seem to be rather weak as predictors.

What would be the best approach for such data? I need something that scales to larger data. I would rather sacrifice accuracy for computational performance, then the opposite, so I'm looking for something simple.

Improve this question
$\endgroup$
8
  • 1
    $\begingroup$ As a broad strategy, maybe estimate the seasonality first, add that as a (more informative) explanatory variable, then do your anomaly/change detection on each time series individually? $\endgroup$ – Danica Feb 5 '18 at 20:39
  • $\begingroup$ @Dougal good point, I can estimate this on aggregate of the individual series. $\endgroup$ – Tim♦ Feb 5 '18 at 20:45
  • $\begingroup$ How about, characterizing all the time series and then clustering? $\endgroup$ – Bussller Feb 7 '18 at 3:12
  • $\begingroup$ @RussellB I'm afraid I can't see how clustering could be used for anomaly detection in time-series (it sounds as rather bad idea) and I'm afraid that clustering in most cases doesn't scale well, so does not meet my constraint. $\endgroup$ – Tim♦ Feb 7 '18 at 9:31
  • $\begingroup$ I agree. Clustering can be used for grouping time series, which might help you with anomalies. Having said that, scalability could be an issue. Have you looked at twitter anomaly detection based on time series? $\endgroup$ – Bussller Feb 7 '18 at 16:46
0
$\begingroup$

Transfer Function model identification enter image description here can be used to develop useful equations that can then be classified or segmented.

"Things" can be simplified for expedience , if that is the goal. Doing this with freely available web resources is a little bit more tricky.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.