1
$\begingroup$

Is there any synthetic / artificial datasets for concept drifting data? I want to visualize the performance of some clustering algorithm when data experiences concept drift and changes over time.

$\endgroup$
2
  • 2
    $\begingroup$ As a question about synthetic datasets to illustrate or investigate a statistical phenomenon, this is more suitable for CV than OpenData in my opinion. $\endgroup$
    – Silverfish
    Feb 18, 2016 at 15:09
  • $\begingroup$ Apologies: CV = CrossCalidated, this site. Questions about data sets are usually considered off topic here and encouraged to go to another site like Open Data instead. My contention was that this question seemed suitable here, though other people may disagree with me. $\endgroup$
    – Silverfish
    Feb 18, 2016 at 16:46

1 Answer 1

1
$\begingroup$

This is a tough question. "Concept drift" is a highly abstracted term that assumes a well developed methodological protocol of text-based constructs temporal evolution. This protocol does not exist, yet.

Standard time series solutions are very well-developed for continuously distributed information, are focused on the analysis of HAC residuals and, obviously, include the variants of Holt-Winters decompositions, exponential smoothing, Box-Jenkins, ARCH, GARCH, HARCH functional forms, spectral decompositions, and so on. Take your pick.

Nonstandard approaches to longitudinal clustering of principal components originated in the 70s with guys working in the (then) hot area of multidimensional scaling and were based on higher order tensor ranks and SVD decompositions such as CANDECOMP and PARAFAC or Pieter Kroonenberg's three-mode approaches:

http://three-mode.leidenuniv.nl/

Time series clustering has been getting a lot of attention in recent years. One excellent overview is Aggarwal and Reddy's book, Data Clustering. However, temporal clustering of conceptual constructs is not a well developed topic in their collection of essays.

Andreas Brandmaier's Permutation Distribution Cluster (PDC) approach to clustering aperiodic time series is well developed conceptually as well as offering routines that can be run in R.

https://cran.r-project.org/web/packages/pdc/pdc.pdf

Your challenge is different from so-called "off the shelf" methods like these. The problem is that even cross-sectional, text-based analysis is a wild, wild west of competing solutions -- without even introducing a temporal component.

Honestly though, I think some of the most interesting solutions aren't strictly focused on concept "clustering," which implies a mostly statistical answer, but are more involved with dimension reduction and the longitudinal evolution of core constructs. For instance, computational sociologists interested in the drift of concepts fundamental to American political history have done some terrific work building on social network-type analyses that include some stunning visuals. Visit this paper by Peter Bearman, at Columbia's INCITE Center which is an analysis of over 200 years of US Presidential State of the Union addresses and the evolution of core constructs underlying them, Lexical shifts, substantive changes, and continuity in State of the Union discourse:

http://www.pnas.org/content/112/35/10837.full.pdf

Bearman also has a paper on Big Data and Historical Social Science which raises concerns about, e.g., "answering previously largely intractable questions about the timing and sequencing of events, and of event boundaries...based on accounts which rest on narrative sentences."

http://bds.sagepub.com/content/spbds/2/2/2053951715612497.full.pdf

Given all of that as background, is there data which presumes concept drift? One possible source are the Large Scale Hierarchical Text Classification Challenges"

http://lshtc.iit.demokritos.gr/

DMOZ is another possible source since it has text metadata with a temporal component, although it likely the case that you may have to define and build the constructs yourself.

http://www.dmoz.org/about.html

Goggle's GDELT project might be another option:

http://gdeltproject.org/#intro

I've always liked the Million Song Database which has millions of pop song features dating back to the 1960s:

http://labrosa.ee.columbia.edu/millionsong/

Here's a paper on the evolution of genres of pop music that is based on that data:

http://www.armandmarieleroi.com/wp-content/uploads/2015/02/dopdyn_10.02.15.pdf

And here's a paper on music and aesthetic analysis called *cantometrics":

http://research.culturalequity.org/psr-history.jsp

Yelp just released 13T of research data that may work for you:

https://www.yelp.com/academic_dataset

And, here's a laundry list of data sources in Github that may have something useful:

http://www.datasciencecentral.com/profiles/blogs/great-github-list-of-public-data-sets?utm_content=buffer484a2&utm_medium=social&utm_source=linkedin.com&utm_campaign=buffer

Apologies for the lack of canned, easy solutions. Good luck!

$\endgroup$
2
  • $\begingroup$ On a separate but related thread, @whuber cites Mosteller and Wallace's book Applied Bayesian and Classical Inference, urging the OP to read it. Needless to say, it's a $50 purchase on Amazon, even used. So, I looked it up in Google Books. Whuber is absolutely right, it is a treasure trove in text analysis...terrific read. books.google.com/… $\endgroup$
    – user78229
    Feb 19, 2016 at 12:25
  • $\begingroup$ Here's an additional, related paper that looks at the historic origins of modern mathematics. Lots of useful metrics and analyses of concepts, paradigms, drift, etc. arxiv.org/pdf/1603.06371v1.pdf $\endgroup$
    – user78229
    Mar 25, 2016 at 18:53

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.