Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

I have data which has several properties (metadata, as key value pairs, where the keyspace is shared over the whole dataset) per object.

I took a sample of objects and divided them in n groups according to an unknown algorithm.

What statistical methods or algorithm exists to find the relevant properties and their weight for the division to receive a similar grouping of the data than the "unknown algorithm" did?

share|improve this question
example: get a list of flickr images with the according metadata. someone sorts them in to two groups (the ones he likes and the one hi does not like so much). then i want to find out if there is possible metadata upon which i could have guessed his choice. – yawniek Dec 17 '10 at 17:24

3 Answers

Since your metadata is probably discrete, I suggest using classification trees. Note that from your example it is highly likely that your unknown algorithm is random, i.e. there is no algorithm.

share|improve this answer

This isn't a clustering, it's (supervised) classification.

There are a lot of methods to do classification, such as naïve bayes for binary features and linear discriminants for continuous, or neural networks for some opaque combination of both.

For the example you mention, the feasibility of what you suggest depends a lot on the metadata - for example, if it's been tagged (=classified) properly, you could expect to be able to find some tags they like/dislike. However, the problem you stated is more general. Discovering the exact algorithm is unlikely, and in the example one doesn't even exist.

share|improve this answer

You can use SOM which is a kind of supervised clustering. Or as sesqu said their are tons of other algorithms such as support vector machines, regression or logistic regression. Neural Networks, etc ..

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.