I'm trying to classify 6-dimension feature vectors in two different classes using the nearest neighbor algorithm. After analyzing my training data, I realized that the same vector is present numerous times in both classes. What does this mean?
- Does it indicate a bad feature choice?
- During training, should I group identical vectors and label it with the class which has the highest count? (i.e., vector A is present in both class A and B, but label it class A since vector A is found more often in class A than in class B)
- something else?