Suppose $X_1$ and $X_2$ are iid from an arbitrary distribution with variance $\sigma^2$. How can we derive an upper bound for: $$P(|X_1-X_2|\ge\delta)$$
One simple idea is Chebyshev's Inequality, however, when $\delta<\sqrt{2}\sigma$, we have $$P(|X_1-X_2|\ge\delta)\le\frac{var(X_1-X_2)}{\delta^2}=\frac{2\sigma^2}{\delta^2},$$ which literally tells nothing. Clearly, this inequality can be improved in this case.
How can we get a better bound? Thank you.