I need to analyze the 100k MovieLens dataset for clustering with two algorithms of my choice, between the likes of k-means, agnes, diana, dbscan, and several others. What tools (like Rattle, or Weka) would be best suited to help me make some simple clustering analysis over this dataset?
4 Answers
Python will give you all the flexibility you need. With the NumPy and SciPy cluster module you have the tools you need, and the datatypes of NumPy give you a good insight in how much memory you will use.
-
$\begingroup$ Why the downvote? Is it not a good answer, or do you think it's not a good tool? $\endgroup$ Jul 22, 2010 at 17:06
-
$\begingroup$ I second the python recommendation here, especially if you have trouble fitting the data set into r. If you do go the python route, have a look at "Programming Collective Intelligence" by Toby Segaran $\endgroup$– PeterRJul 22, 2010 at 18:29
-
$\begingroup$ What downvote? I'm not familiar with Python yet, but it seems promising, I'll take a look. $\endgroup$ Jul 23, 2010 at 11:32
-
$\begingroup$ @Victor, the first vote was a downvote (so it's now 2 upvotes/1 downvote). Maybe someone didn't like this tool. Happy I could help :) $\endgroup$ Jul 23, 2010 at 11:34
-
$\begingroup$ I'll give you +1 (so that you now have your 2 original upvotes :), just because I agree that with many data points, Python may be a good option; now the minor point, IMO, is that there're not so many clustering algorithms available in SciPy compared to R. $\endgroup$– chlSep 13, 2010 at 6:16
Python's scikit-learn library (ml library built atop numpy and scipy) is quite popular, very well documented and has several clustering algorithms as described here.
-
-
1
can we use matlab for this work?I also need to cluster movielense dataset, my data is mixed of numeric and categoric dataset. what can I do?
-
1$\begingroup$ Hi samira, and welcome to the site! Your post seems to be a new question rather than an answer to the question. I suggest that you delete this answer and post it either as a comment. See also the help pages of this site. $\endgroup$ Jul 15, 2013 at 11:50