Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

In document classification (document categorization) field, researchers recommend always a few standard dataset, such as Reuters-21578, RCV1(Reuters Corpus Volume 1). However, these datasets only contain documents related to specific domain, for instance, newswire stories.

However, if we really want to classify any given documents (1 million) in a more wide range of topics, like literature, sports, politics, science, etc. How can we accomplish this task?

If the classification (supervised learning) doesn't work, could anyone tell me some more advanced methods to automatically categorize any topic documents ?

share|improve this question
add comment

1 Answer

If the classification (supervised learning) doesn't work, could anyone tell me some more advanced methods to automatically categorize any topic documents ?

There's also clustering (unsupervised learning). It will try to see distinct difference between your articles. The only problem there is that you can't actually tell what group is what, since it's only based on difference (euclidean norm or other). But that could be helpful too since maybe some articles that goes into the "sport" category can appear to be very similar to the "leasure" articles. Looking at it that way may help you to redefine your groups.

However, if we really want to classify any given documents (1 million) in a more wide range of topics, like literature, sports, politics, science, etc. How can we accomplish this task?

If you want computer automatically complete this stuff, by looking at the articles then classification is the only way (that I know). Since it looks like it doesn't work correctly for you, it's not necessary statistically unmeaningful thing. But I higly doubt that there's no distinct difference can be found in 1 million articles, so again, maybe you're creating too much groups?

If you're looking for another corpus texts you should try prebuilt text from RTextTools. There's a set called NYTimes (again for articles) and USCongress (something different, a sample dataset containing labeled bills from the United States Congress)

You're questions looks a bit general to me, so maybe I understood it incorrectly. So correct me if I wrong.

share|improve this answer
    
In fact, I prefer to have 10-20 general categories, and 100-200 sub-categories among them. Then I guess at least 100 documents among every sub-category will help to train a reliable model, to predict massive documents (1 million for example). The classifier I am using is LibSVM, it works fine but I lack suitable training data. :-( I'll have a look at the tool you proposed. Thanks ! –  Ensom Hodder Jun 21 '12 at 10:53
    
Semi-supervised learning may also be an option: you still need a representative training set, but only part of it has to be labelled. –  Vincent Zoonekynd Jun 22 '12 at 0:20
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.