# Which hypothesis test to use to compare two data sets that have a lot of zeros?

I'm working on an analysis project that is really pushing the limits of my statistics knowledge and I'd love some advice! The project involves measuring the outcome from a pricing test in which one group of customers is shown a higher price than others. This leads to lower conversion in the test group (fewer people buy the product), but more revenue per purchase. I can measure which one is more successful by simply measuring which group generates more total revenue, but I'm stuck on how to test this data for statistical significance.

My current approach is to build a dataset that includes the revenue for each individual customer that views a price. If they buy the product, they create revenue of a certain amount. If they don't buy the product, they create zero revenue. Here are two sample datasets:

control <- (0, 0, 15, 0, 25, 0, 17, 0, 0, 12, 0)

test <- (0, 0, 0, 0, 30, 0, 19, 0, 0, 20, 0)


In this example, control had a higher conversion rate, but test generated more revenue per user. I want a test that can help me understand whether test or control are likely to generate more total revenue (or if I don't have enough data to say either way). So far I've tried running a simple t-test on the two datasets, since I was hoping that I had enough data points to not worry about the data not being normally distributed. I've also been looking at the Wilcoxon Test, but I'm having a hard time understanding it!

Sorry if this is a basic question, but any advice at all would be super helpful!

• Go for a nonparametric permutation test instead of a t-test. Commented Jul 16, 2023 at 8:04