I am doing a principal components analysis on a 4 item psychological scale (response format is a 0-10 point Likert scale for each item). As I hoped, an exploratory factor analysis yielded one factor. The result are looking good, one factor explains 83% of variance, the correlation coefficients are high but not too high (0.7-0.8), the KMO and Bartlett's tests are all fine.
My problem is that 4 residuals (66%) of the reproduced correlations are over an absolute value of 0.05. I know this is a problem, but am trying to establish how much of problem this is to the model. Also what (if anything) can be done to fix it? Any answers or advice on where to find answers would be appreciated.