Linked Questions

19 votes
1 answer
24k views

What is the optimal distance function for individuals when attributes are nominal?

I do not know which distance function between individuals to use in case of nominal (unordered categorical) attributes. I was reading some textbook and they suggest Simple Matching function but some ...
Jane Doe's user avatar
  • 341
6 votes
1 answer
31k views

Hierarchical or TwoStep cluster analysis for binary data?

(This question is an edited version of a question I previously posted which one user recommended would benefit from more focus). I have 2000 questionnaires from respondents which ask 33 different ...
user27768's user avatar
6 votes
2 answers
4k views

Jaccard similarity coefficient vs. Point-wise mutual information coefficient

Can you explain the difference between the Jaccard similarity coefficient and the pointwise mutual information (PMI) measure? It would be great if you could add a few examples.
Moein's user avatar
  • 173
8 votes
2 answers
14k views

Accuracy vs Jaccard for multiclass problem

TL;DR For a multiclass problem, is Jaccard score the same as accuracy? Update March 29, 2019 The wrong implementation in scikit-learn is now fixed with pull request #13151. Hooray! P.S. The lesson ...
Ivan Aksamentov - Drop's user avatar
7 votes
2 answers
2k views

What's the name of this correlation/association measure between binary variables?

There are several measures of association (or contingency or correlation) between two binary random variables $X$ and $Y$, among others Pearson's phi coefficient Cramér's V I wonder how the ...
Hans-Peter Stricker's user avatar
2 votes
1 answer
5k views

What data structure to use for my cluster analysis or what cluster analysis to use for my data?

I have a large dataset of categorical variables. The data consists of shoppers who purchased two items during a single trip to a store. There are approximately 75,000 cases and 1,500 different ...
user37000's user avatar
3 votes
0 answers
3k views

should I count repeated items in jaccard similarity?

I have two lists: A and B where Size(A) = 4 and size(B) = 10. I would like to find the Jaccard similarity between these two lists. Suppose A = {Tom, George, John, Jennifer} and B={Tom, Jessica, ...
mOna's user avatar
  • 103
2 votes
3 answers
2k views

Cosine Similarity Intuition

I understand what cosine similarity is and how to calculate it, specifically in the context of text mining (i.e. comparing tf-idf document vectors to find similar documents). What I'm looking for is ...
ccb's user avatar
  • 21
2 votes
0 answers
1k views

Cosine similarity between two types of user profiles

I have a movie dataset containing preference (ratings) of users on movies and also attributes of movies (genre, cast, director). I created two types of profiles for users based on the movie attributes ...
mOna's user avatar
  • 103
3 votes
2 answers
170 views

Distance calculation on variables that cannot be represented in the Euclidean space

Given a variable such as number of events attended together, which is more of a multi-dimensional data how can you calculate a sort of distance between people (i.e. ...
Raunak Thomas's user avatar
0 votes
1 answer
364 views

What is the optimal number of clusters?

I am doing a cluster analysis with agglomerative hierarchical clustering on my asymmetrical binary data. For finding the number of clusters, I tried all three of the most mentioned methods (Elbow, ...
user339807's user avatar