Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I have been using a/b testing in order to optimise changes I make to my websites. Previously, I have set a single conversion goal and have ended up with a conversion rate for each group. I then used R (with the power.prop.test function) to calculate the power and significance of the change in conversion rate to decide when it is safe to stop the test and be confident that the values have meaning.

I am now able to get information on a wide range of metrics about the site for each group. However I am not sure how to do the same test for an arbitrary metric - e.g., revenue. Could someone point me in the right direction? I am happy to use R so just pointing me at the right set of functions would be great, but I do like to try and understand what I am calculating so any explanations or links to useful site would be even better.

share|improve this question

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.