I want to compare how my computation model performs to the experimental data. For the experimental data I have proportions of different type of cells like the below table -
Cell Type | Proportion |
---|---|
Type A | 90% |
Type B | 1% |
Type C | 0.2% |
... | ... |
... | ... |
... | ... |
For the model data, instead of single proportion values for each type I have multiple proportion values corresponding to the multiple runs of the model. Example of my model data, is the following -
Cell Type | Proportion |
---|---|
Type A | [90%,89%,92% ... ] |
Type B | [1%,0.8%,0.9%,1.2% ..] |
Type C | [0.2%,0.7%,0.11%.. ] |
... | ... |
... | ... |
... | ... |
I want to test whether the values generated by model is similar to the experimental data. I am a bit confused about what statistical test to use. The following are my thoughts on this -
- Initially I was thinking of applying a simple t-test for each of the Cell Type. But I think , it is not recommended to compare t-tests for proportions data. And if I use that since I will be performing multiple t-tests, should I do some correction (Bon-Ferroni) to my significance level.
- Do I need to worry about the skewness of the proportion values (some are really high like 89% and some are really low like 0.2%).
- Can I use bootstrapping to get 95% confidence interval for each of the Cell Type, and then see whether my experimental proportion falls into the confidence interval as a test.
Kindly let me know, what statistical test to be used.
The other thing that is confusing me even more is the following - Since I want to test that my model is similar to the experimental data, hence my alternate hypothesis should be that my model data and the experimental data should be similar, but in all the above tests I am assuming this to be my null hypothesis and hence making it easier for me to pass these tests. This is because a p-value greater than the level of significance , will show that model is similar to experimental data.