In order for the CLT to hold we need the distribution we wish to approximate to have mean $\mu$ and finite variance $\sigma^2$. Would it be true to say that for the case of the Cauchy distribution, the mean and the variance of which, are undefined, the Central Limit Theorem fails to provide a good approximation even asymptotically?
The distribution of the mean of $n$ i.i.d. samples from a Cauchy distribution has the same distribution (including the same median and inter-quartile range) as the original Cauchy distribution, no matter what the value of $n$ is.
So you do not get either the Gaussian limit or the reduction in dispersion associated with the Central Limit Theorem.