Skip to main content
3 votes
Accepted

Simulation of type-1 error rate, and how to check type-2-error (rate)

Your t-test is calculating a p-value for a sample from a population where the mean is 0.5 and the standard deviation is 5. You are testing the null hypothesis that the mean in the population is zero. ...
Jeremy Miles's user avatar
  • 18.6k
2 votes
Accepted

Data Processing for self-report measures before conducting inferential test. Sum, mean or leave it as-is?

Option 1 and 2 are inefficient, as you convert two values into one. Option 3 treats the observations as independent values, which they are not. You would underestimate the uncertainty and any test ...
Frans Rodenburg's user avatar
2 votes

P-value of 0 when comparing two treatments using bootstrap method

You don't need to do any bootstrap when your issue is really that you're having trouble interpreting a classical test. The t-test and Wilcoxon are telling you the same thing. The mean of sample 1 is ...
AdamO's user avatar
  • 64.1k
2 votes
Accepted

Should I use the paired t-test or the unpaired t-test for comparing two sets of measurements on a similar subject?

This appears to be an unpaired problem - if I understand correctly, you're running the same program 30 times in a row on the same test bed, not running it over a battery of 30 different tests. The ...
Nuclear Hoagie's user avatar
1 vote

Required sample size with unequal variances

Besides simulations, there is an approximate (but generally quite good) solution and a more accurate solution. Not all libraries or software offer the more accurate solution; you'll have to refer to ...
J-J-J's user avatar
  • 5,427

Only top scored, non community-wiki answers of a minimum length are eligible