1
$\begingroup$

I have a bunch of factor variables. I believe the data comes from only a few clusters. I'd like to analyze the data and perform data reduction. I want to know the most important variables for predicting membership in each of the classes.

I've found the poLCA package. It does almost everything that I need. The poLCA.posterior function gives the pdf of class membership conditional on variable values. This is OK, but not quite what I want, because there is no data reduction. I don't know which variables I could drop while not sacrificing much in terms of classification accuracy.

$\endgroup$

1 Answer 1

1
$\begingroup$

@jessica Data reduction for categorical variables is an interesting concept. Let's first discuss what is Data Reduction (DR)? Often in literature and research DR is equated with dimensionality reduction. DR is broadly of two types, Feature Selection (FS) and Feature Extraction (FE). Note, there exists a major difference between the two.

  • While a given FS method will focus on reducing the original set of features into a subset that explains the maximum variance. The FS method will maintain the original feature set. In short, it will NOT transform the original features or variables BUT will only derive those features or variables that explain the maximum variance. There exists both supervised and unsupervised FS techniques that aim to work with labelled or unlabeled datasets. Some FS methods are Information Gain Relief, Chi Squares, Fisher Score.

  • Whereas a FE method will focus on transformingthe original set of features into a subset that explains the maximum variance. The FS method will NOT maintain the original feature set. In short, it will transform the original features or variables and replace them with transformed variables. A well known FE method is Principal Component Analysis (PCA). Note, PCA will orthogonally transform the original features into a subset of Principal Components (PCs). Also note, mapping the PCs to the original set of variables is hard. Besides PCA will work only for continuous variables. If you want to conduct FE on categorical variables, I suggest use Multiple Correspondence Analysis (MCA). Other FE methods are Linear Discriminant Analysis (LDA) and Cannonical Correlation Analysis (CCA).

With this brief discussion, lets focus on the R package. Try the FactoMineR package. Recently, I asked a similar question on StackOverflow. I invite you to read the discussion.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.