Skip to main content
Cross Validated

Return to Question

replaced http://stats.stackexchange.com/ with https://stats.stackexchange.com/
Source Link
Community Bot
Community Bot
  • 1

I am trying to find what permutation size $B$ I should be using for conducting a permutation test. Currently I have two samples which are normal, same mean but different variance. The sample sizes are the same at $N_1 = 30$ and $N_2 = 30$. Obviously it is not feasible to find and evaluate each permutation as $60 \choose 30$ = 1.182646e+17. Hence, I am trying to find the upper bound on what I should make $B$. I noticed that there was already some literature and people have asked questions:

Required number of permutations for a permutation-based p-valueRequired number of permutations for a permutation-based p-value

However, it seems that the upper bound doesn't depend on my sample size but rather the precision. Does anyone know why and how I may be able to obtain a reasonable bound for my sample size of 60? Thanks!

I am trying to find what permutation size $B$ I should be using for conducting a permutation test. Currently I have two samples which are normal, same mean but different variance. The sample sizes are the same at $N_1 = 30$ and $N_2 = 30$. Obviously it is not feasible to find and evaluate each permutation as $60 \choose 30$ = 1.182646e+17. Hence, I am trying to find the upper bound on what I should make $B$. I noticed that there was already some literature and people have asked questions:

Required number of permutations for a permutation-based p-value

However, it seems that the upper bound doesn't depend on my sample size but rather the precision. Does anyone know why and how I may be able to obtain a reasonable bound for my sample size of 60? Thanks!

I am trying to find what permutation size $B$ I should be using for conducting a permutation test. Currently I have two samples which are normal, same mean but different variance. The sample sizes are the same at $N_1 = 30$ and $N_2 = 30$. Obviously it is not feasible to find and evaluate each permutation as $60 \choose 30$ = 1.182646e+17. Hence, I am trying to find the upper bound on what I should make $B$. I noticed that there was already some literature and people have asked questions:

Required number of permutations for a permutation-based p-value

However, it seems that the upper bound doesn't depend on my sample size but rather the precision. Does anyone know why and how I may be able to obtain a reasonable bound for my sample size of 60? Thanks!

Source Link
user123276
user123276
  • 2.1k
  • 1
  • 24
  • 39

For a permutation test, why does an upper bound for the number of permutations $B$ not depend on the sample size?

I am trying to find what permutation size $B$ I should be using for conducting a permutation test. Currently I have two samples which are normal, same mean but different variance. The sample sizes are the same at $N_1 = 30$ and $N_2 = 30$. Obviously it is not feasible to find and evaluate each permutation as $60 \choose 30$ = 1.182646e+17. Hence, I am trying to find the upper bound on what I should make $B$. I noticed that there was already some literature and people have asked questions:

Required number of permutations for a permutation-based p-value

However, it seems that the upper bound doesn't depend on my sample size but rather the precision. Does anyone know why and how I may be able to obtain a reasonable bound for my sample size of 60? Thanks!