9
$\begingroup$

I am searching for existing datasets that we can use to test several datavis techniques we are researching.

I know several resources like those included in R (try plot(Orange) or see here).

But I'd like to take it one step forward:

  • Which are the best real-world datasets to test a visualization tool?
  • Which datasets have you used in academic papers or teaching slides about datavis?
  • Which is the best example from the real world to show the advantages of graphing?
Improve this question
$\endgroup$
6
  • 2
    $\begingroup$ Many good real-world examples, with some of the linked projects providing the data sets (but most don't, unfortunately): infosthetics.com $\endgroup$ – WSkid Sep 27 '11 at 21:52
  • 1
    $\begingroup$ Are you expressly looking for free data sets? $\endgroup$ – Fomite Oct 6 '11 at 18:12
  • 3
    $\begingroup$ Visualization depends on context and audience (among other things), suggesting that "best" is ambiguous in this context. You may get more focused, pertinent replies by indicating what "techniques" you are researching. $\endgroup$ – whuber♦ Oct 6 '11 at 19:53
  • 1
    $\begingroup$ @whuber Techniques, about automatization of visualization. Best, for explain. Best, for benchmark. $\endgroup$ – robermorales Oct 8 '11 at 9:47
  • $\begingroup$ @EpiGrad Yes, as free as possible. $\endgroup$ – robermorales Oct 8 '11 at 9:48
5
+50
$\begingroup$

There are large number of databases available on internet. Depending on the subject, you can get different sources.

For example, in Human Development subject area you can have data sources at (http://hdrstats.undp.org/):

http://hdrstats.undp.org/en/tables/default.html

For Climate change observation, there is a web with high resolution climate data at (http://www.ipcc-data.org/), for example:

http://www.ipcc-data.org/obs/cru_ts2_1.html

Both examples, contains real data, used in published scientific papers, with large quantity of data. Time related and/or space related data. Visualization possibilities of those data are endless.

Improve this answer
$\endgroup$
4
  • $\begingroup$ which of the possible datasets from these magnific sources do you like best? thanks $\endgroup$ – robermorales Oct 11 '11 at 12:06
  • 1
    $\begingroup$ It depends on the suitability for the "taste" of visualization. For example, to explore/show time series the IPCC web have enough data and is widely used (obviously for analyzing the climate change), to show spatial data the Human Development website contains a lot of space-related data as well as data related to time. $\endgroup$ – Jose Zubcoff Oct 11 '11 at 15:25
  • $\begingroup$ Your first link is broken (DNS error). $\endgroup$ – horaceT Jul 20 '16 at 16:59
  • $\begingroup$ Unfortunately the first link is broken (5 years later), but there's a lot of Open data out there: kaggle.com/datasets data.okfn.org/data data.gov data.europa.eu/euodp/en/data $\endgroup$ – Jose Zubcoff Nov 23 '16 at 16:53
9
$\begingroup$

I like to use the Anscombe data sets (also available in R) to show the importance of plotting when doing regressions. If you aren't familiar, you get the same regression line and diagnostics from all four data sets, even though the sets themselves all look quite different. You can take the plots below and turn them into residual plots to illustrate problems that you might look for in the residuals after performing a regression.

Anscombe data sets

Improve this answer
$\endgroup$
3
  • $\begingroup$ Yeah, we did know that datasets. It is a good starting point. $\endgroup$ – robermorales Sep 27 '11 at 18:08
  • $\begingroup$ The main problem is that it is not a real-world dataset. $\endgroup$ – robermorales Sep 27 '11 at 18:17
  • 3
    $\begingroup$ @robermorales, Fair enough, but I think that seeing the "pure" version of the problem makes it easier to understand messier, real-world visualizations/problems. $\endgroup$ – Charlie Sep 27 '11 at 18:26
6
$\begingroup$

which is the best example from the real world to show the advantages of graphing?

Any big table. For examples, google images of "official census table". You'll see things like the one below.

Also look at Gelman et al. (2002) Let's Practice What We Preach: Turning Tables into Graphs. American Statistician 56:121-130

huge complicated table

Improve this answer
$\endgroup$
1
  • $\begingroup$ good tip! We don't know the ref. $\endgroup$ – robermorales Sep 28 '11 at 6:58
4
$\begingroup$

William S. Cleveland has two books full of great uses of graphics, and the data and code to create the graphs in Visualizing Data is on his website

Improve this answer
$\endgroup$
3
  • $\begingroup$ which of the datasets by Cleveland do you like more? thanks $\endgroup$ – robermorales Oct 11 '11 at 12:06
  • 1
    $\begingroup$ @robertomorales I think they are all well chosen for their purposes. Anyone interested in statistical graphics should study Cleveland carefully. $\endgroup$ – Peter Flom Oct 11 '11 at 16:50
  • 1
    $\begingroup$ The data for Visualizing Data can be found at lib.stat.cmu.edu/datasets/visualizing.data.zip I can no longer find them on Cleveland's own website. $\endgroup$ – Nick Cox Jun 28 '18 at 12:08
4
$\begingroup$

Possibly you already know of these, but here they are anyway:

The UCI Machine Learning Repository has many publicly accessible, real world data sets.

The US Government makes many of its datasets public at data.gov.

If you want some tricky visualization data, I'd suggest looking at a classification task. Seems to me that the Bag of Words set on the UCI MLR has some nice properties, but I could be mistaken (been a while since I used it).

Improve this answer
$\endgroup$
1
  • $\begingroup$ Thanks! There are a lot! $\endgroup$ – robermorales Oct 8 '11 at 9:43
3
$\begingroup$

Here are a few.

Sci2 Tool Sample Datasets
http://wiki.cns.iu.edu/display/SCI2TUTORIAL/2.5+Sample+Datasets
Sample datasets that come bundled with Sci2 Tool.

Tableau Sample Data Sets
https://public.tableau.com/s/resources?qt-overview_resources=1#qt-overview_resources
Sample data sets for getting started with Tableau.

Awesome Public Datasets
https://github.com/caesar0301/awesome-public-datasets/blob/master/README.rst
This list of public data sources is collected and tidied from blogs, answers, and user responses. Most of the data sets are free, some are not.

This thread is rather old, hoping this bump will get some new contributions!

Improve this answer
$\endgroup$
2
$\begingroup$

I just noticed loads of datasets here:

http://www.inside-r.org/howto/finding-data-internet

Don't know if that's any use?

I'm afraid I don't teach visualisation so I can't comment on your specific questions.

Improve this answer
$\endgroup$
0
$\begingroup$

The datasaurus, available as an R package on CRAN provides a great alternative to Anscombe's data - it is also simulated, but really helped me to teach the importance of exploratory data viz.

It is a set of 12 datasets that all have the same summary statistics despite having radically different distributions - including a fun one that plots as a dinosaur shape. I think it is superior to Anscombe because it highlights that exploratory data viz is not just about identifying how a regression line can be fit, but about exploring the nature of the data.

Improve this answer
$\endgroup$
2
  • 1
    $\begingroup$ Please paste in whatever context is necessary to understand & answer your question. We want this thread to remain valuable even if the link goes dead. $\endgroup$ – kjetil b halvorsen♦ Mar 15 at 16:20
  • $\begingroup$ I added a brief description and a link to CRAN, which is unlikely to go dead anytime soon. $\endgroup$ – Lukas Wallrich Mar 16 at 9:31

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.