# Calculating the uncertainty on a ratio result in A/B test

If I am running an A/B test in which I have two randomly assigned groups of users and I am calculating a conversion on some action, how do I then calculate the uncertainty on the result?

For example, if group A has 1000 users of which 100 took the desired action, and group B has 1000 users and 90 took the action I would end up with a conversion rate of 0.1 and 0.09 respectively but I really want to be able to state something about the uncertainty on these rates.

My naive approach would be to assume sqrt(N) as the statistical uncertainty on each number and use the propagation of error approach, differentiating the ratio, but I'm not confident that this is the correct approach.

For example, suppose you repeat A and B many times, and you find that you can model them as independent normal variables $A$ and $B$ (whose parameters you find). The ratio will have a Cauchy distribution. Once you obtain this Cauchy distribution, you can calculate whatever you want on it.