I have two samples, my hypothesis is that both of them are equal. The number of experiments is different (N), the means are very similar and the medians are 5 and 4.
First I calculate descriptive statistics to find:
N1: 1077 Mean1: 8.39 Median1: 5 StDev1: 23.14 Skewness1: 8.20 Kurtosis1: 101.241 N2: 729 Mean2: 8.37 Median2: 4 StDev2: 16.62 Skewness2: 21.18 Kurtosis2: 568.66
First of all, I think the population is not normal, it is skewed to the left close to 0.
Next, I made the box plot of both samples to visually compare them, they looked quite similar.
Finally I did a two sample t-test, 95% CI and resulted in 0,98 p-value. The p-value being so close to 0, I could say that the samples are equal right?
However, the samples are not normally distributed so I am not sure if I can use the t test.
Did I proceed correctly? How should I proceed otherwise?
Edit (more info about the test):
Basically, I had quite an active forum which I changed in a way that... the users were not so happy about. Now, the amount of activity in terms of new topics and new replies has decreased but what I want to compare is, if a new topic is posted is it likely to have the same, less or more replies now than before the change.