You should take a look at some of the nonparametric Bayesian approaches (see this paperthis paper and this paperthis paper) to factor analysis which do not assume the number of factors to be known; the first one can also model the case where the factors have a dependency structure among them.