What happens when you try to find standard deviation of a (non-truncated) cauchy distribution? I have read that this doesn't work, but I do not understand exactly why. Please can someone explain.
 A: I thought I would take a stab at it.
The standard formula for the standard deviation assumes that a standard deviation exists.  One way to look at it would be to imagine that you created a pattern recognition program that recognizes noses.  Imagine that if you feed in an image, then it will output the location of the nose.
Vertebrates have noses.  Nothing else has a nose.
If you run the nose finding algorithm on a tree, it will still output the location of the tree’s nose.  As you can imagine, that will be a meaningless thing to do.
So what I did was create 100,000 samples of thirty observations each from the standard Cauchy distribution in R.  I used it to compare the estimates of the interquartile range and the algorithmic estimate of the standard deviation that appears in most textbooks.
First, I estimated the interquartile range (IQR) and the standard deviation (SD) for each sample using the R functions IQR and sd.  The distribution of one estimate versus the other is here.

Second, I restricted the estimate of the SD to 750, which is about 99.5% of the cases. Its graph is here.

Fifty percent of the data for the entire set falls between $\pm{1}$.  Tukey’s five point summary for the data is
Minimum      -417,190
1 Quartile   -1
Median        0
3 Quartile    1
Maximum       4,285,676
The average estimated value of the SD is 52.28. Remember that half the data falls between -1 and 1.
Tukey’s five-point summary for the SD is
Minimum      0.75
1 Quartile   3.76
Median        6.47
3 Quartile    13.76
Maximum       782,453
On the other hand, the IQR is reasonably well behaved, as can be seen by the sampling distribution of the IQR.  I could not produce a visual for the sampling distribution of the SD because it is too irregularly shaped.

The worst sample of the 100,000 samples, in terms of estimating the IQR was sample 42447.  It's plot is

As you can see, the SD is all over the place because it doesn't exist.  Formally speaking, it is undefined.  So is the nose on a tree.
The code to create it was
rm(list=ls())
library(ggplot2)
library(ggthemes)
set.seed(500)

observations<-30
experiments<-100000

x<-matrix(rcauchy(observations*experiments),nrow = observations)

scale_estimates<-data.frame(standard_deviation=apply(x,2,sd), Interquartile_range=apply(x,2,IQR))

a<-ggplot(data = scale_estimates,aes(Interquartile_range,standard_deviation))+theme_wsj()
a<-a+geom_point()+ggtitle("IQR Versus Standard Deviation")

print(a)

a<-ggplot(data = scale_estimates,aes(Interquartile_range,standard_deviation))+theme_wsj()
a<-a+geom_point()+coord_cartesian(ylim = c(0,750))

print(a)

print(fivenum(scale_estimates$standard_deviation))

print(mean(scale_estimates$standard_deviation))

print(fivenum(as.vector(x)))

print(mean(x))

a<-ggplot(data = scale_estimates,aes(Interquartile_range))+theme_wsj()
a<-a+geom_density()+ggtitle("IQR Sampling Density")
print(a)

print(fivenum(scale_estimates$Interquartile_range))
print(mean(scale_estimates$Interquartile_range))

print(scale_estimates[scale_estimates$Interquartile_range>8.5,])



worst_estimator_data<-data.frame(x=x[,42447])

a<-ggplot(data = worst_estimator_data,aes(x))+theme_wsj()
a<-a+geom_density()+ggtitle("KDE of Worst Sample")
print(a)

I do apologize, I didn't annotate the R code.  I got sleepy.  You will need to change the worst plot if you change the seed or comment it out.
One thing I did not do was increase the sample size.  If I had, the measurement of the SD would have gotten larger and crazier, while the sampling distribution of the IQR would have narrowed.
The estimates of the SD of the Cauchy distribution get worse as the sample size gets larger and larger.
I think this example emphasizes one very useful thing.  The formulas that appear in textbooks are not the true values.  They are estimators.  In this case, a true mean, variance or standard deviation do not exist, but the formula doesn't vanish.  It just doesn't do anything useful.
