I have a very basic question but I cannot find an answer (especially for a clustering situation). I am trying to do hierarchical clustering of samples using jaccard distances. One sample contains fewer observations but they are all present in another sample. However, when I calculate the jaccard distance, this is not taken into account and two samples are very far away. How do you take into account this? Is there another way to use somehow make that weight more in the clustering? thanks!
Maybe you used Jaccard similarity rather than Jaccard distance...
The subset property alone shouldn't give a small distance.
Consider a set with 100 items, and a one element subset of it. That is a subset but it's also almost completely dissimilar isn't it?