Can you recommend a text mining package in R that can be used against large volumes of data?
Secondly, is there a GUI available for any of the text mining packages in R?
Thirdly, is there another open source text mining program that is easy and intuitive to use?
-
$\begingroup$ @mbq: well, "is there an open source text mining package with a GUI?" would probably cover all three questions pretty well, it kind of already is one question... $\endgroup$– naught101Commented May 4, 2012 at 2:54
7 Answers
Please see the CRAN Task View on Natural Language Processing which includes, among others, the tm package already mentioned by Josh.
See the tm package and this presentation by Stefan Theussl given at the 2010 R/Finance conference.
Here are two further integrated projects:
- Python Natural Language Toolkit (easy installation, good documentation)
- Java MALLET (no experience with it, but looks promising; included in the link given by @Nick)
Both are open-source software.
Sure, RapidMiner with the text mining extension.
There are many videos that show how it is done.
-
2$\begingroup$ here is a 5-part video series: vancouverdata.blogspot.com/2010/11/… $\endgroup$ Commented Feb 21, 2011 at 20:52
GATE is very comprehensive. It also allows you to work with different languages and has an ontology editor.
Andrew McCallum (UMass) has a few NLP related software projects available on his webpage. These are all in Java (I think) with source code available.
Besides the CRAN Task View on Natural Language Processing mentioned by Dirk, there are quanteda package and NLP package.