The k-means algorithm does the following:
Given a set of points, we first choose k random points to be the initial centroids.
We then create k clusters. The ith cluster contains the points nearest to the ith centroid.
Now, we calculate the means of points in each cluster. Thus we have k means. These k means form the updated k centroids. We then create new k clusters as described in step 2.
We keep doing steps 2. and 3. until the k centroids stop changing positions
My question is - what happens if two or more of the initial randomly chosen centroids turn out to be the same (I'm talking about the centroids chosen randomly in the first step)?
My first intuition is that we would just proceed as it is, without any changes to the algorithm.
Is this how that works? Or is there a guarantee that the initial centers are never going to be the same?