I write to you for 3 questions.
I want to calculate confidence intervals on different measures of association (Pearson's correlation coefficient, Cramer's V and the Eta-square). I will make the distinction between the asymptotic CIs (assuming a normal distribution for the statistic of interest) and the bootstrap CIs. So, the choice is either use asymptotic normal CIs or use a bootstrap CIs.
1) If the numerical variable(s) for the Pearson's coefficient and for the Eta-square are gaussian, we can use the asymptotic CIs to calculate the CIs. But, in this situation, we could as well use the bootstrap CIs. If we have the choice, which one to prefer between the asymptotic and the bootstrap CIs ? And why ? I have read they have the same accuracy in theory, but which is better in practice ? Better the asymptotic in this case because bootstrap involves some additional uncertainty ?
2) Regardless whatever measure of association we take (even with very large sample size), by definition we cannot rely on symmetric CI as each of our measures is numerically limited to either the range of -1 to +1 or 0 to +1. As a consequence their CI will always be skewed. So, we never ever assume a symmetric CI for a measure of association, and better start from the assumption they are NOT normally distributed. So, in all cases it will be better to use bootstrapping CIs or to consider Z-transformations while calculating them directly. Are you ok ?
3) II often work with very small sample size (n<50) and often skewed (asymmetrical) distribution sampling. Bootstrap CIs do not cure the problems of small sample sizes. Although BCa CIs may outperform traditional CIs for small samples from non-normal populations (see, e.g., Davison & Hinkley, 1997, pp. 230-231), their coverage for small sample sizes can still differ substantially from the nominal 1 – α. Which bootstrap CIs would you recommend me in case of small sample size and asymmetrical distribution sampling ? The BCa sounds a good choice, what do you think ?
Best, looking forward to reading you.