I have point pattern data for the distribution of animals in fields. I'm hoping that the community can confirm (or soundly dismiss!) my newbie understanding of the silhouette method. Would it be the case that if the animals were randomly distributed in the fields, that the silhouette coefficient would hover around zero? And no matter what k was? Many thanks in advance.

  • $\begingroup$ I assume you mean Kaufman & Rousseeuw's Average Silhouette Width (ASW). This is normally computed from a distance and a clustering, usually generated by a clustering method. You haven't specified any of these, but ASW values will depend on them. There's no answer to your question possible without knowing these. (Actually chances are there is no perfect answer even if you specify them either, but I can say at least something then.) Also don't assume that people know what you mean if you use undefined notation ("k"). $\endgroup$ Nov 14 '21 at 18:04
  • 1
    $\begingroup$ This question is problematic because to compute Silhouette criterion, you must do the clustering. Cluster results depend much on the method, the number of extracted clusters k, the dimensionality, and, also, it will capitalize on some random cluster structure always observed in random data. Why not you do many such simulation probes yourself? I tentatively expect that on the average Silhouette will be a little greater than 0 (I didn't check it). $\endgroup$
    – ttnphns
    Nov 14 '21 at 19:04
  • $\begingroup$ This, albeit not an answer, could be of some interest for you $\endgroup$
    – ttnphns
    Nov 14 '21 at 19:05
  • $\begingroup$ @ttnphns I have seen ASW values below 0 in situations with not too small $k$. If the number of clusters is large, the closest cluster to an observation may be quite close. Although maybe this requires dimensionality larger than 2 for random data. $\endgroup$ Nov 15 '21 at 0:45
  • $\begingroup$ Thank you very much, everybody. I'm sorry to be unclear. My head was so deep in the details that I couldn't see what I left out! I mean the coefficient called s(i) as described in Rousseeuw 1987 (JCAM 20:53-65). We are implementing it in R package "factoextra." We use k means clustering. Our purpose is to get a silhouette plot with the scores for different numbers of clusters (in this context k = number of clusters). $\endgroup$
    – sboyd
    Nov 15 '21 at 18:37

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.