I am doing A/B testing for ad display, where the wording on the ad is different between the two groups.
Metrics gathered:
1) # of people the ad reached
2) # of people who clicked on the ad and were brought to website
3) # of people who purchased from website
4) $ sales for each purchase.
I calculated the p-value based on the conversion rate of people who saw the ad vs people who clicked on ad.
How could I measure the significance of the difference in avg sales between groups? Is that something that can be compared even though the experience once on the website would be the same for both the test and control groups?