# Data structures and libraries for high dimensional text analysis with R

I am going to be using R for text analysis (mostly clustering, classification and some visualization) and was wondering what mechanisms R provides for handling high dimensional, sparse data sets. If I understand correctly, R does provide some packages (e.g., matrix library) for handling large and sparse matrices - which brings me to my question.

Specifically, I would like to know:

1. Which R libraries are most appropriate for storing and processing high dimensional sparse data? Just FYI, my data will fit into memory.

2. Do such libraries inter-operate with existing text analysis (clustering/classification) packages? Would I need to convert these sparse data structures to and from data frames if I need to text analysis? Wouldn't that add additional time overhead to the computations?

I am fairly new to R, so please excuse me if this sounds vague (or too general).

• Any thoughts on this one? I will appreciate any pointers. Thanks. – Andy Nov 20 '11 at 1:54

This does not help you? http://tiny.cc/ns73n Moreover, you can install sos R package to search any function in R, by using findFn() function in the sos package.