I have about 10 variables (features) and want to do cluster analysis of cases (data points). I have a number of ideas about which variables to be included for cluster analysis:
Plot the variables pairwise in scatter plots and see if there are rough groups by some of the variables;
Do factor analysis or PCA and combine those variables which are similar (correlated) ones.
Use all of the variables in clustering, and after cluster analysis use ANOVA (or similar group comparison technique) to test if there is difference between the clusters, and delete those variables by which there's no significant differences among clusters, and then run clustering again, and test again.
Are there better ways to decide which variables to be used for cluster analysis?
Thank you for your input.