Feature selection and latent variables I would like to know if it is useful (or maybe dangerous) to reduce the number of attributes (by selecting the most informative ones among thousands) before seeking for latent variables or not (in an exploratory perspective).
A subsidiary question: in the same case, would it be beneficial to select the most important features for each categorie of features (these can be compressed using an entity-attribute-value model which is not really suitable for data mining) before detecting the latent variables?
 A: Briefly, the answer is maybe (It is hard for me to tell what you are going to do with your data after variable selection has been performed). It is known that for least squares or PLS regression, feature selection should be performed prior to construction of the final model. The reason for this is that the mean squared error of prediction for these models has a term which depends on $(p/n)^2$ where $p$ is the number of 'attributes', and $n$ is the number of observations (or samples). The number of latent factors used in PLS is evidently immaterial in this result. In my view, this somewhat undermines the raison d'etre of PLS, but I still find it useful.
A: How dangerous this activity is depends upon the properties of your features and the tests that you use to reduce the feature number. It may be the case that you will not find the "one-test-fits-all" method for reducing features, in which case its important to understand and state the assumptions you're making when performing the test.
It is hard from your statement to judge what the purpose of the latent variables is in your analysis. However, depending upon your data, feature selection is useful because too much data may serve to dampen your true signal and add noise to classification. 
