Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

I am looking for large (>1000) text corpus to download. Preferably with world news or some kind of reports. I have only found one with patents. Any suggestions?

Thanks in advance.

share|improve this question
This thread appears to be off topic. See meta.stats.stackexchange.com/questions/1032/…. – whuber Jun 7 '12 at 21:39

5 Answers

Do not the Wikileaks texts suit you?

share|improve this answer
+1 Heh, good idea. – mbq Nov 24 '11 at 22:07
But how could I download them in .txt – Dimitar Vouldjeff Nov 24 '11 at 22:44

The reuters text corpus is a classic in the field, and can be found here

share|improve this answer
It's not the most interesting (or diverse) corpus. The license is also restrictive relative to Wikileaks (public domain US documents) or wikinews. – ariddell 19 hours ago

What about wikinews? Here's the latest database dump I could find: http://dumps.wikimedia.org/enwikinews/20111120/

You probably want the "All pages, current versions only."-version.

share|improve this answer

If recency is not an issue, you can try

http://www.infochimps.com/datasets/20-newsgroups-dataset-de-duped-version

and there are other many more similar dataset in infochimp depending on your budget.

Regards, Andy.

share|improve this answer

If you want precomputed n-grams, you could try the google books archive:

http://books.google.com/ngrams/datasets

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.