I have a test and control group for online visitors. I want to compare these two groups based on:
- Conversion Rate ie a difference of proportions test
- Average Revenue ie a difference of means test
The groups are identical for both kinds of test so basically I have only one dataset. Do I need to do some correction to my pvalue threshold for declaring statistical significance for the two tests?
I have been reading up on multiple comparisons problem but was not sure if it applies to different kinds of tests.