9
$\begingroup$

Grants often require power analysis to support a proposed sample size. In proteomics (and most -omics), there are 100's to 1000's of features/variables measured across 10's of samples (maybe 100s, but unlikely). Also, it is known that some of these measurement units (e.g., spectral counts of proteins) are not normally distributed and so we will use non-parametric test for analysis. I have seen the power of a sample size determined assuming a single measurement and assuming a t-test, but I don't think this is completely correct. Another problem with spectral counts specifically is that each of the 100's of features is on very different scales with vastly different errors (larger values have less error). [ This problem is nicely described in the limit fold change model, Mutch et al., 2002 ]

What would be the appropriate way to determine the power of a proposed sample size given some assumptions of FDR and an acceptable fold-change? Using the tool here I was able to determine given the following:

  • 300 genes
  • 3 false positives
  • 1.4 fold-differences
  • 0.8 desired power
  • 0.7 stdev

requires a sample size per group of 49.

This was handy since I am proposing a 50v50 design, know that 1.4 fold-change is pretty accepted, 1% FDR is fine, and I will probably measure 300 proteins in this experiment. This problem of power or sample size calculation will continue to occur, so it would be nice to have a referenced approach in place.

EDIT: I read where a colleague proposed to model spectral counts from negative binominal distributions using the likelihood function followed by a Wald test. Basically uses prelim data to get protein variance estimates and then calculate detectable fold changes between groups for each quantile. There is also an FDR (alpha) input. So, given a >80% power and set sample size, they can determine detectable fold-changes for 25% lowest variance, 50% smaller variance, and 25% highest variance. Problem is that I don't know how they did this. Not sure if sharing this approach will help anyone with a possible answer.

$\endgroup$
4
  • $\begingroup$ Some other resources I have found on this subject: Levin 2011 Dicker et al., 2010 $\endgroup$
    – Ben
    Commented May 27, 2014 at 18:16
  • 1
    $\begingroup$ That MD Anderson calculator seems overly optimistic to me. How many comparisons are done? (I'm too rusty on microarrays: 300 genes in a 50v50 design means that you make how many comparisons??) When you set the FDR calculator to 3 false positives, are you saying that you are setting a false positive error so that only 3 are expected to be false positives under the null? That's too strict for more than 60 comparisons. $\endgroup$
    – AdamO
    Commented Mar 30, 2018 at 14:22
  • 1
    $\begingroup$ I can show you how this would be done in R but I just need some background on the biology. $\endgroup$
    – AdamO
    Commented Mar 30, 2018 at 14:23
  • $\begingroup$ @AdamO, maybe you could share with us how you would do it in R? Not sure what kind of background you would need, but usually in proteomics we have the following information: a) number of genes/proteins whose abundance we want to compare across conditions (via t-test or ANOVA, equal or unequal groups size), b) the desired FDR of the statistical test (usually following BH), c) the minimum fold-change to call a gene/protein significantly regulated (totally arbitrary, but it help us a lot to decide which gene/protein we should follow-up with additional experiments). $\endgroup$
    – pisistrato
    Commented Sep 1, 2021 at 14:13

1 Answer 1

1
$\begingroup$

In applications (especially ethical applications, where you have to do a power study) I like using this reference [Wang and Chen 2004], because it nicely explains the concept behind a power calculation for high-throughput data (whatever the data actually is).

In essence, in addition to the usual parameters (α, β, N, effect size) you use two additional parameters, λ and η. The latter, η, is the assumed numbered of truly altered genes, and λ is the fraction of the truly altered genes that you want to be able to detect. It is quite straightforward to expand any known power calculations to a high-throughput data using this approach.

Wang, Sue-Jane, and James J. Chen. "Sample size for identifying differentially expressed genes in microarray experiments." Journal of Computational Biology 11.4 (2004): 714-726.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.