Skip to main content
1 of 2
Aksakal
  • 62.3k
  • 6
  • 106
  • 206

Running Monte Carlo on undefined value is a common trap when working stable distributions or distributions with fat tails. For instance, suppose you are dealing with Cauchy distribution. You get a bunch of realizations and calculate the mean. The problem is that Cauchy doesn't have a mean, so your result is going to be nonsense.

Here's why. Your Cauchy random numbers are $x_i$, and you calculate the average $\bar x=\frac 1 n\sum_{i=1}^nx_i$. When you have good behaving random numbers, due to CLT the variance of $\bar x$, which is itself a random number is going to decline with sample size increase as $\sigma^2/n$ where $\sigma^2=Var[x_i]$.

With Cauchy distribution and with stable distributions this doesn't happen. The variance will keep growing with sample size. So, the same thing happens in Monte Carlo simulations: you get the finite result for the estimator, but its variance increases as you run more simulations, so your mean becomes less and less certain. Actually, with Cauchy distribution the variance itself is undefined: $\sigma^2=\infty$

Aksakal
  • 62.3k
  • 6
  • 106
  • 206