Linked Questions
11 questions linked to/from Similarity Coefficients for binary data: Why choose Jaccard over Russell and Rao?
19
votes
1
answer
24k
views
What is the optimal distance function for individuals when attributes are nominal?
I do not know which distance function between individuals to use in case of nominal (unordered categorical) attributes.
I was reading some textbook and they suggest Simple Matching function but some ...
6
votes
1
answer
31k
views
Hierarchical or TwoStep cluster analysis for binary data?
(This question is an edited version of a question I previously posted which one user recommended would benefit from more focus).
I have 2000 questionnaires from respondents which ask 33 different ...
6
votes
2
answers
4k
views
Jaccard similarity coefficient vs. Point-wise mutual information coefficient
Can you explain the difference between the Jaccard similarity coefficient and the pointwise mutual information (PMI) measure? It would be great if you could add a few examples.
8
votes
2
answers
14k
views
Accuracy vs Jaccard for multiclass problem
TL;DR For a multiclass problem, is Jaccard score the same as accuracy?
Update March 29, 2019
The wrong implementation in scikit-learn is now fixed with pull request #13151. Hooray!
P.S. The lesson ...
7
votes
2
answers
2k
views
What's the name of this correlation/association measure between binary variables?
There are several measures of association (or contingency or correlation) between two binary random variables $X$ and $Y$, among others
Pearson's phi coefficient
Cramér's V
I wonder how the ...
2
votes
1
answer
5k
views
What data structure to use for my cluster analysis or what cluster analysis to use for my data?
I have a large dataset of categorical variables. The data consists of shoppers who purchased two items during a single trip to a store.
There are approximately 75,000 cases and 1,500 different ...
3
votes
0
answers
3k
views
should I count repeated items in jaccard similarity?
I have two lists: A and B where Size(A) = 4 and size(B) = 10. I would like to find the Jaccard similarity between these two lists.
Suppose A = {Tom, George, John, Jennifer} and B={Tom, Jessica, ...
2
votes
3
answers
2k
views
Cosine Similarity Intuition
I understand what cosine similarity is and how to calculate it, specifically in the context of text mining (i.e. comparing tf-idf document vectors to find similar documents). What I'm looking for is ...
2
votes
0
answers
1k
views
Cosine similarity between two types of user profiles
I have a movie dataset containing preference (ratings) of users on movies and also attributes of movies (genre, cast, director). I created two types of profiles for users based on the movie attributes ...
3
votes
2
answers
170
views
Distance calculation on variables that cannot be represented in the Euclidean space
Given a variable such as number of events attended together, which is more of a multi-dimensional data how can you calculate a sort of distance between people (i.e. ...
0
votes
1
answer
364
views
What is the optimal number of clusters?
I am doing a cluster analysis with agglomerative hierarchical clustering on my asymmetrical binary data. For finding the number of clusters, I tried all three of the most mentioned methods (Elbow, ...