The goal of my meta-analysis project is to combine proportions from studies without a control group.
In Practical Meta-Analysis, Lipsey and Wilson mentioned that the logit transformation should be used when proportions are less than 0.2 or more than 0.8 instead of using raw proportions. But they didn't mention the double arcsine transformation. Barendregt et al. have claimed the double arcsine transformation to be a preferred option. I wonder which method you guys would prefer to use and how you would do to decide which one to use.
I tried to find out how to determine which method to choose by trying to replicate the results of a handful of studies using both methods (I also used the arcsine square root method). Here is my approach: For each study, I first transformed the original data using the logit and the double arcsine transformation. I then generated Q-Q plots and histograms of these transformed data. After that, I compared their skewness and kurtosis in order to see if they were in the acceptable range. Then I conducted the Shapiro-Wilk test. By now, I would have a basic idea of which method would be better for me to use, but I wonder how you would make the decision.
The thing is, sometimes, both methods could lead to very similar results; sometimes, neither of the methods was able to pass the Shapiro-Wilk test; sometimes, both methods failed to normalize the data; sometimes, the arcsine square root transformation seemed to have done a better job. In these situations, what would you do?