In general, multiple group CFA is a good tool for comparing the equivalence of a measurement model across two groups.
However, you first need to show that the measurement model makes sense in at least one group.
First, analyse the entire sample
There are many different ways of tackling factor exploration. Here are some thoughts
- Consider analysing the factor structure of the entire sample of 180.
- If the confirmatory CFA is giving poor fit, you might want to run an exploratory factor analysis to see what is going on in the data. Are there items loading on factors other than theorised? Do the number of factors theorised seem reasonable relative to factor structures you get with a few more or a few less factors?
- Also, it is not uncommon for item-level CFAs with large numbers of items per factor to yield relatively poor fit. This can be explained both in terms of how we think about fit statistics in such contexts, and also in terms of the simplicity of many measurement models. For example, it is quite common for there to be a number of systematic deviations from the idealised structure (e.g., items with common words correlating more highly; items close together correlating more highly; items that both negatively worded correlating more highly; etc.). Without incorporating these, dare I say, nuisance characteristics, fit will often be poor even when the theorised structure is a reasonable approximation.
- Some people adopt an item parcelling approach to CFA that often smooths out some of these low-level item characteristic effects. Note that there is some controversy over the appropriateness of this approach. Item parcelling is often appealing to researchers, perhaps wrongly, because it can improve fit statistics to satisfy conventional criteria and therefore increase the ability to get published. A more reasonable justification for item-parcelling is in situations where you are not interested in the item-level and are only interested in more general characteristics of the scale. Anyway, in your case, you might want to examine item parcelling as it also reduces the number of parameters that need to be estimated.
- With regards to sample size, I agree that more would be better, but my sense is that you'll still be able to get interesting results with 180. You can use fit statistics with confidence intervals to quantify associated uncertainty due to the smaller sample size.
Multiple group CFA
So, if, and only if, you can get a good model at the overall level would I proceed to multilple group CFA.