I have a test and control group for online visitors. I want to compare these two groups based on:

  1. Conversion Rate ie a difference of proportions test
  2. Average Revenue ie a difference of means test

The groups are identical for both kinds of test so basically I have only one dataset. Do I need to do some correction to my pvalue threshold for declaring statistical significance for the two tests?

I have been reading up on multiple comparisons problem but was not sure if it applies to different kinds of tests.

  • $\begingroup$ Proportions of what? Means of what? $\endgroup$ – BruceET Jun 30 at 19:56

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.