Tagged Questions

0
votes
0answers
21 views

Massive Textual Corpus [duplicate]

Possible Duplicate: Where to find a large text corpus? I know someone has asked a similar question here, but I'm wondering whether anyone knows of a large textual corpus that is available ...
0
votes
3answers
81 views

Is there any dataset or api that gives a list of infrequent words? [closed]

I'm actually working on an information retrieval project, and I want to extract words that are of significance from a sentence. This is somewhat opposite to stopwords. In a sentence like: He was a ...
0
votes
2answers
347 views

Looking for datasets to practice Text Mining [closed]

I'm a newbie at Data Mining, but have recently started dabbling around with it. I have been using RapidMiner as my tool, and am now playing with Text Mining. I was wondering if anyone knew of any ...
5
votes
2answers
470 views

Suggestions on how to merge multiple datasets with an imperfect ID across databases?

I have four databases of books that I have assembled from various sources, websites, etc. I would like to merge the databases, but I face a significant merging issue in that there is no "perfect" ...
4
votes
2answers
158 views

How to classify country names given possible alternate spellings or abbreviations?

Let's say I have a list of users who have specified the country they reside in by typing in something. I want to find the total number of users who came from the US, the UK, and everywhere else. But, ...
5
votes
2answers
511 views

Algorithms for clustering documents by similar words and phrases

I'm working on a project where I'm trying to take a pair of documents and find and group (cluster) similar words and phrases between them. Which algorithm would solve this kind of a problem? I know ...
2
votes
1answer
313 views

How to reduce dimension for text document dataset?

I have a basic doubt in dimension reduction for text dataset eg. 20Newsgroup, rcv1 etc. Initially I extract the number of word occurrence in each document, i.e word x document matrix would be $n ...
0
votes
1answer
220 views

Is there a corpus specifically for categories like sports, entertainment, or health?

I am experimenting with Classification algorithms in ML and am looking for some corpus to train my model to distinguish among the different text categories like sports, weather, technology, football, ...
4
votes
1answer
157 views

Determining trends in text

I have a bunch of documents (66 quarterly reports on grievances and complaints on health care services provided and growing) and a list of words that I'd like to follow over time. What is the easiest ...