# Questions tagged [statistical-power]

Is a property of a hypothesis testing method: the probability of rejecting the null hypothesis given that it is false, i.e. the probability of not making a type II error. The power of a test depends on sample size, effect size, and the significance ($\alpha$) level of the test.

1,378 questions
Filter by
Sorted by
Tagged with
1 vote
1 answer
14 views

### Sample size calculation for moderated moderation (three way interaction: continuous x continuous x continuous)

If I am planning to analyses some data using a moderated moderation (Hayes - model 3). What is the most appropriate technique to calculate required sample size? Currently, I have written a simulation ...
• 147
2 votes
1 answer
31 views

### What is the effect size h in pwr::pwr.p.test in R?

The R package pwr has a function for calculating the required sample size for a one-sample proportion test (I assume a z-test ...
• 32.5k
0 votes
0 answers
19 views

### $H_2$, its might and Type III error

I've recently found myself wondering about the following thing in hypothesis testing: We can test some null hypothesis $H_0$ and reject it based on its p-value. This is akin to accepting (shreek!!!) ...
• 233
1 vote
1 answer
27 views

### Observed power simulation with simr to find smallest interesting effect size

I have a data set with N=18 and a simple linear model y ~ factorX*numericR + (1|id). I now found a significant but small correlation for numericR (-0.24). I did not run a power analysis to determine ...
• 29
1 vote
1 answer
23 views

### Estimating size of validation cohort

We have generated an elastic net model on a small dataset, where we use gene expression data to calculate a biomarker score to discriminate patients with condition X vs controls. The dataset is too ...
• 85
0 votes
0 answers
14 views

### How do you perform a power analysis of a Lmer test?

I know R has built in power test functions but I was wondering if anyone knows how to do a power analysis of an existing Lmer test within R?
• 101
0 votes
0 answers
16 views

• 501
3 votes
3 answers
84 views

### P-value under 5% but power under 80%

Im trying to understand how to accurately report results on AB tests If my type 1 error is 5% and type 2 is 20% , can we have instances where the p-value is < 0.05 and power is < 0.8? If so, how ...
0 votes
1 answer
20 views

### Sample size calculation for Cox regression with time-varying exposures

I'm involved in the design of a longitudinal observational study investigating a relationship between the use of a drug and a binary outcome. Participants are enrolled when at risk of the outcome, ...
• 111
0 votes
0 answers
43 views

### Power / sample size estimation for chi-square test with continuity correction in R

1._Some authors mention that they estimate sample size for chi-square test with continuity correction. For instance: Sample-size calculation is based on Pearson's Chi-square test with a two-sided ...
• 933
2 votes
0 answers
21 views

### How to deal with ragged power curve

I am exploring various methods for sample size calculation and power analysis from binomial data, and frequently coming up against ragged power curves that go up and down as sample size increases. I ...
0 votes
0 answers
12 views

### Questions for calculation power/sample size in (multi group) structural equation modeling

I will measure a certain characteristic in an intervention group and in a control group over four points in time. I want to construct a latent change score model to check if the groups develop ...
• 111
9 votes
3 answers
637 views

### Report power if result is statistically significant

We have submitted a paper reporting a statistically significant result. One reviewer asks us to report what is the power to detect a significant association. As there was a previous paper on this ...
• 111
1 vote
1 answer
29 views

### Error in wp.logistic: ‘p0’ must be numeric in (0,1)? What to do when p0 is negative?

I am trying to find out the sample size I need for a future study using a reanalysed existing dataset to enter the values in a WebPower script. I am using the intercept and odds ratio/estimate of my ...
0 votes
0 answers
42 views

### How to calculate power?

I was wondering how you calculated the power via Gpower with these results? There are a total of 87 participants and the alpha level is 0.05. It is a longitudinal design in which I performed a ...
2 votes
1 answer
90 views

### Post hoc power analysis for multilevel regression analysis

I have a multilevel model with 2 levels (L1 = individuals, at least 710 per country; L2 = countries, 17 total) ...
• 1,438
1 vote
0 answers
16 views

### How to Ensure Saturation Using Grounded Theory?

In quantitative causal inference, we do power analysis to determine the minimum sample size to achieve (1 - $\beta$) statistical power of our hypothesis test with a specific $\alpha$ statistical ...
• 175
2 votes
0 answers
94 views

### When the anticipated sample size is not reached in a clinical trial

How to justify precisely a situation where the expected sample size is not reached? For example, the sample size for our study protocol was determined on the basis of a fixed statistical power of 80%. ...
0 votes
0 answers
4 views

### repeated measures design vs. MANOVA power analysis

My collaborator and I are building a study where participants will read some profiles that vary for 3 dimensions each having 3 levels (9 profiles in total). For each profile participants will have to ...
0 votes
1 answer
39 views

### Power issue for categorical vs. continuous predictor in lmer

I have the following model: ...
1 vote
2 answers
42 views

### Does StatsModels' power.tt_ind_solve_power assume a single standard deviation despite two different means?

Does StatsModels' power.tt_ind_solve_power (link) assume a single standard deviation despite two different means? I think so. Why is this a reasonable assumption? I come from a primarily Bayesian ...
• 1,634
1 vote
2 answers
57 views

### Question regarding post-hoc power analysis

I am having trouble with interpretation of a prospective superiority randomised controlled trial. Study characteristics: Study design: Alpha value = 0.05 1-beta = 0.8 Predicted effect size =0.15 [P1 =...
• 11
1 vote
0 answers
27 views

### Required sample size of CFA using power analysis from semPower

I want to conduct a confirmatory factor analysis (CFA) for a model with 4 latent variables and 60 indicator variables (15 per factor, uncorrelated factors, hence 1,710 degrees of freedom, that is, ...
1 vote
3 answers
110 views

### Python package for this power analysis calculator [closed]

I would like to use the following power analysis formula into a python notebook https://clincalc.com/stats/samplesize.aspx Any idea which python package would replicate the same results ? Edit: I ...
0 votes
0 answers
20 views

### Convergence algorithm for power analysis?

I found this algorithm on a shared drive and I'm really curious how it works. From appearances, it's used to estimate the MDE in power analysis when the effect size (difference of proportion means) ...
• 1,634
0 votes
0 answers
38 views

### Calculating Sample size of a linear regression

I just would like if anyone knows how to calculate the sample size for the data set given the significance level is set at alpha = 0.05 and the power of the test should be 80%. The linear regression ...
0 votes
0 answers
13 views

### GLMM: X=Non integer warnings for power estimation

For starters I am both new to R and out of practice for statistics. I am going to run an experiment where participants answer a survey every day for a week, and I want to figure out the sample size I ...
2 votes
1 answer
26 views

### power analysis via Monte Carlo when effect size, means, and std unknown

Say you want to execute an experiment to see whether a treatment is better than a control and want to properly power your experiment. However, you have no beliefs a prior regarding the treatment's ...
• 1,634
0 votes
0 answers
30 views

### Calculating the power of an experiment

I'm working through a question in Gelman - Regression and Other Stories and I find myself getting confused with the following question; 'Power, type M error, and type S error: Consider the experiment ...
0 votes
0 answers
48 views

### Most powerful test for hypothesis testing with uniform and exponential distributions

Given sample of single observation $x_{[1]}$, we are checking hypothesis $H_0 \sim U[0, 1]$ versus $H_1 \sim Exp(1)$. I need to find most powerful test for hypothesis checking with given Type I error ...
• 201
1 vote
1 answer
34 views

### low sample size experimental design, t-test vs one way ANOVA

I'm designing a biological experiment wherein the sample size is very limited, as each sample is very hard to get. Moreover, I need to have 4 independent groups, each receiving a different treatment. ...
• 73
0 votes
0 answers
21 views

### Power estimation and analysis for multiple 3x3 count tables

In my design, each subject produces a 3x3 contingency table.So I have a table of counts of how many times a subject responded X Y Z in condition A, B or C. All the columns sum up to 50 (num of trials ...
1 vote
1 answer
31 views

### How to calculate how many levels of nuisance factor I need for a desired power level in my experiment

I have a nuisance factor that introduces a lot of variation in my data. I want to know how many levels of this factor I need to include in my blocked design to get a power level of, say, 90%. As an ...
0 votes
0 answers
25 views

### Compare mean of subsamples between groups

I am going to collect quantitative data for two groups that I would like to compare. I have done a two sample t-test on some preliminary data and found a significant difference, but I don't think that ...
1 vote
1 answer
36 views

### Computing the power for binomial regression with indicator variables

My question is kind of a sequel to this one. For an experiment I'm designing, I want to model the outcomes by a binomial regression, something like ...
• 6,363
2 votes
1 answer
45 views

### What is the purpose of accrual period in survival analysis?

Before reading the answer to this question, I, like the original poster, thought that we have to take the accrual period into account because some subjects might die before we start the treatment. But,...
• 6,363
0 votes
0 answers
20 views

### Mixed Model Convergence Issues With LMER

I am fairly new to statistics and I want to run power analyses on my models, so I was hoping to get some insight on model convergence issues. I am using a dataset in which I am examining the effects ...
• 1
0 votes
0 answers
30 views

### Three-way manova or separate anovas?

I have three independent catagorial variables and two dependent continuous scale variables, so I want to compare means across these three independent catagorial variables. I think here the best choice ...
• 57
0 votes
0 answers
27 views

### Power analysis: How do you calculate the power (1-B) based on the matched-pairs biserial correlation effect size?

I am running a Wilcoxon-signed rank test, and as suggested by King et al., the best effect size to report for this analysis would be the matched-pairs rank biserial correlation. How is the power (1-B) ...
0 votes
1 answer
68 views

### How to power a strong superiority hypothesis in an A/B test

Suppose I would like to perform an A/B Test, where it only makes sense to implement the "treatment" over the "control" if the "treatment" is atleast 2% better than the &...
• 341
0 votes
2 answers
71 views

### Is it incorrect to say that $\text{Power} = P(\text{reject } H_0)$?

Is it incorrect to say that $\text{Power} = P(\text{reject} H_0)$? I've seen in my textbook as well as other sources power is always defined as the conditional probability \$P(\text{reject } H_0 : H_a ...
1 vote
1 answer
72 views

### Statistical power of tests on unequal and known variances vs equal but unknown variances

Suppose you are testing for differences in two normally distributed variables. In the following situations: -Variables have known but unequal variances -Variables have variances that are unknown but ...
• 11
0 votes
0 answers
9 views

### How to get within standard deviation in mixed models

I wonder how to get the within standard deviation in mixed models. Does anyone have an explanation? If not in mixed models, how would it otherwise be done? Thanks! ...
• 177