# How to represent the probability of a point belonging to a cluster?

I want to do a scatter plot with a two-dimensional dataset. Suppose I have only 3 clusters. Then, I could assign each cluster a color of these: red, green and blue. If soft-assignment was made, then each datapoint would have a certain probability of belonging to each cluster. One can make that clear visually plotting each point in the scatter plot with an RGB value of $[p_1,p_2,p_3]$, where $p_i$ is the probability of that point to belong to cluster $i$.

This works for 2 or 3 classes. But what if I had more than 3? Is there a way to represent these probabilities in an intuitive way, preserving the position of each sample in the 2D space? I'm using R to do the plots, if that gives any useful information.

• Since the space of color perception is three-dimensional, and color is known to be relatively poor at representing quantitative properties in the first place, this question looks like a dead end. It sounds rather like you are seeking some effective method of visualizing estimated probabilities of membership in more than three classes. Why not, then, ask a version of the question that is more directly relevant to your objective? Is there a reason you are committed to trying to use color?
– whuber
Sep 17, 2018 at 15:03
• @whuber You are totally right, I don't know why I stuck to colors. I am indeed looking for any kind of representation that helps visualizing these probabilities. Sep 17, 2018 at 15:06
• How about a stacked barplot?
– mkt
Sep 17, 2018 at 18:17
• Yeah, it wouldn't work for large ones. But it can work for modest sizes, by sorting and plotting very thin lines. Analogous to STRUCTURE plots in population genetics where each colour indicates a different contributing source population, e.g. g3journal.org/content/ggg/4/12/2389/F2.large.jpg
– mkt
Sep 17, 2018 at 18:57
• @mkt I really liked the pie approach. If you could post some example code in R showing how to do it you would definitely get the accepted answer. Datasets I'm dealing with are not that large, 300 samples at most. Sep 18, 2018 at 17:31

In general, this is a challenging problem, especially given the constraint that the relative positions in 2D space should be retained.

In the absence of that constraint, I would recommend a stacked bar plot. With thin bars and a sorted dataset, colours can easily be used to indicate the probability of belonging to different clusters for a fairly substantial number of points. Plots such as these are common in population genetics and can convey a fair amount of useful information, such as in this example.

If we are to stick with the constraint of retaining relative positions in 2 dimensions, I can think of one solution that would work for modest-sized datasets with a small number of clusters. For these cases, you can plot each point as a small pie; the segments of the pie denote the probability of belonging to each cluster.

Here is a worked example using 3 clusters

# Loading required libraries
library(e1071)
library(ggplot2)
library(scatterpie)

# Generating data frame
dat <- data.frame(a = c(rnorm(50, mean = 10, sd = 3),
rnorm(50, mean = 20, sd = 3),
rnorm(50, mean = 30, sd = 3)),
b = c(rnorm(50, mean = 10, sd = 5),
rnorm(50, mean = 20, sd = 3),
rnorm(50, mean = 30, sd = 3)))

# Identifying clusters and calculating cluster probabilities using
#  fuzzy c-means clustering
clustdat <- cmeans(dat, centers = 3)

# Adding cluster information to dataset
dat$clusters <- as.factor(clustdat$cluster)
dat$A <- clustdat$membership[,1]
dat$B <- clustdat$membership[,2]
dat$C <- clustdat$membership[,3]

# Plotting
ggplot() + geom_scatterpie(aes(a, b, group = clusters),
data = dat, cols = LETTERS[1:3])


Note that this may be useful with >2 dimensions as well, by combining this with some sort of dimension reduction technique (for plotting - the clustering can be done in multidimensional space).

Maybe you don't need to exactly encode the distribution.

Define a color for "mixed", e.g., gray.

Then interpolate between your cluster palette and gray depending on the difference between $p_\max$ and the second largest probability.