# Questions tagged [statistical-power]

Is a property of a hypothesis testing method: the probability of rejecting the null hypothesis given that it is false, i.e. the probability of not making a type II error. The power of a test depends on sample size, effect size, and the significance ($\alpha$) level of the test.

1,378 questions
Filter by
Sorted by
Tagged with
1 vote
14 views

### Sample size calculation for moderated moderation (three way interaction: continuous x continuous x continuous)

If I am planning to analyses some data using a moderated moderation (Hayes - model 3). What is the most appropriate technique to calculate required sample size? Currently, I have written a simulation ...
31 views

### What is the effect size h in pwr::pwr.p.test in R?

The R package pwr has a function for calculating the required sample size for a one-sample proportion test (I assume a z-test ...
19 views

### $H_2$, its might and Type III error

I've recently found myself wondering about the following thing in hypothesis testing: We can test some null hypothesis $H_0$ and reject it based on its p-value. This is akin to accepting (shreek!!!) ...
1 vote
27 views

### Observed power simulation with simr to find smallest interesting effect size

I have a data set with N=18 and a simple linear model y ~ factorX*numericR + (1|id). I now found a significant but small correlation for numericR (-0.24). I did not run a power analysis to determine ...
1 vote
23 views

### Estimating size of validation cohort

We have generated an elastic net model on a small dataset, where we use gene expression data to calculate a biomarker score to discriminate patients with condition X vs controls. The dataset is too ...
14 views

### How do you perform a power analysis of a Lmer test?

I know R has built in power test functions but I was wondering if anyone knows how to do a power analysis of an existing Lmer test within R?
16 views

84 views

### P-value under 5% but power under 80%

Im trying to understand how to accurately report results on AB tests If my type 1 error is 5% and type 2 is 20% , can we have instances where the p-value is < 0.05 and power is < 0.8? If so, how ...
20 views

### Sample size calculation for Cox regression with time-varying exposures

I'm involved in the design of a longitudinal observational study investigating a relationship between the use of a drug and a binary outcome. Participants are enrolled when at risk of the outcome, ...
43 views

### Power / sample size estimation for chi-square test with continuity correction in R

1._Some authors mention that they estimate sample size for chi-square test with continuity correction. For instance: Sample-size calculation is based on Pearson's Chi-square test with a two-sided ...
21 views

### How to deal with ragged power curve

I am exploring various methods for sample size calculation and power analysis from binomial data, and frequently coming up against ragged power curves that go up and down as sample size increases. I ...
12 views

### Questions for calculation power/sample size in (multi group) structural equation modeling

I will measure a certain characteristic in an intervention group and in a control group over four points in time. I want to construct a latent change score model to check if the groups develop ...
637 views

### Report power if result is statistically significant

We have submitted a paper reporting a statistically significant result. One reviewer asks us to report what is the power to detect a significant association. As there was a previous paper on this ...
1 vote
29 views

### Error in wp.logistic: ‘p0’ must be numeric in (0,1)? What to do when p0 is negative?

I am trying to find out the sample size I need for a future study using a reanalysed existing dataset to enter the values in a WebPower script. I am using the intercept and odds ratio/estimate of my ...
42 views

### How to calculate power?

I was wondering how you calculated the power via Gpower with these results? There are a total of 87 participants and the alpha level is 0.05. It is a longitudinal design in which I performed a ...
90 views

### Post hoc power analysis for multilevel regression analysis

I have a multilevel model with 2 levels (L1 = individuals, at least 710 per country; L2 = countries, 17 total) ...
1 vote
16 views

### How to Ensure Saturation Using Grounded Theory?

In quantitative causal inference, we do power analysis to determine the minimum sample size to achieve (1 - $\beta$) statistical power of our hypothesis test with a specific $\alpha$ statistical ...
94 views

### When the anticipated sample size is not reached in a clinical trial

How to justify precisely a situation where the expected sample size is not reached? For example, the sample size for our study protocol was determined on the basis of a fixed statistical power of 80%. ...
4 views

### repeated measures design vs. MANOVA power analysis

My collaborator and I are building a study where participants will read some profiles that vary for 3 dimensions each having 3 levels (9 profiles in total). For each profile participants will have to ...
39 views

### Power issue for categorical vs. continuous predictor in lmer

I have the following model: ...
1 vote
42 views

### Does StatsModels' power.tt_ind_solve_power assume a single standard deviation despite two different means?

Does StatsModels' power.tt_ind_solve_power (link) assume a single standard deviation despite two different means? I think so. Why is this a reasonable assumption? I come from a primarily Bayesian ...
1 vote
57 views

### Question regarding post-hoc power analysis

I am having trouble with interpretation of a prospective superiority randomised controlled trial. Study characteristics: Study design: Alpha value = 0.05 1-beta = 0.8 Predicted effect size =0.15 [P1 =...
1 vote
27 views

### Required sample size of CFA using power analysis from semPower

I want to conduct a confirmatory factor analysis (CFA) for a model with 4 latent variables and 60 indicator variables (15 per factor, uncorrelated factors, hence 1,710 degrees of freedom, that is, ...
1 vote
110 views

### Python package for this power analysis calculator [closed]

I would like to use the following power analysis formula into a python notebook https://clincalc.com/stats/samplesize.aspx Any idea which python package would replicate the same results ? Edit: I ...
20 views

### Convergence algorithm for power analysis?

I found this algorithm on a shared drive and I'm really curious how it works. From appearances, it's used to estimate the MDE in power analysis when the effect size (difference of proportion means) ...
38 views

### Calculating Sample size of a linear regression

I just would like if anyone knows how to calculate the sample size for the data set given the significance level is set at alpha = 0.05 and the power of the test should be 80%. The linear regression ...
13 views

### GLMM: X=Non integer warnings for power estimation

For starters I am both new to R and out of practice for statistics. I am going to run an experiment where participants answer a survey every day for a week, and I want to figure out the sample size I ...
26 views

### power analysis via Monte Carlo when effect size, means, and std unknown

Say you want to execute an experiment to see whether a treatment is better than a control and want to properly power your experiment. However, you have no beliefs a prior regarding the treatment's ...
30 views

### Calculating the power of an experiment

I'm working through a question in Gelman - Regression and Other Stories and I find myself getting confused with the following question; 'Power, type M error, and type S error: Consider the experiment ...
48 views

### Most powerful test for hypothesis testing with uniform and exponential distributions

Given sample of single observation $x_{}$, we are checking hypothesis $H_0 \sim U[0, 1]$ versus $H_1 \sim Exp(1)$. I need to find most powerful test for hypothesis checking with given Type I error ...
1 vote
34 views

### low sample size experimental design, t-test vs one way ANOVA

I'm designing a biological experiment wherein the sample size is very limited, as each sample is very hard to get. Moreover, I need to have 4 independent groups, each receiving a different treatment. ...
21 views

### Power estimation and analysis for multiple 3x3 count tables

In my design, each subject produces a 3x3 contingency table.So I have a table of counts of how many times a subject responded X Y Z in condition A, B or C. All the columns sum up to 50 (num of trials ...
1 vote
31 views

### How to calculate how many levels of nuisance factor I need for a desired power level in my experiment

I have a nuisance factor that introduces a lot of variation in my data. I want to know how many levels of this factor I need to include in my blocked design to get a power level of, say, 90%. As an ...
25 views

### Compare mean of subsamples between groups

I am going to collect quantitative data for two groups that I would like to compare. I have done a two sample t-test on some preliminary data and found a significant difference, but I don't think that ...
1 vote
36 views

### Computing the power for binomial regression with indicator variables

My question is kind of a sequel to this one. For an experiment I'm designing, I want to model the outcomes by a binomial regression, something like ...
45 views

### What is the purpose of accrual period in survival analysis?

Before reading the answer to this question, I, like the original poster, thought that we have to take the accrual period into account because some subjects might die before we start the treatment. But,...
20 views

### Mixed Model Convergence Issues With LMER

I am fairly new to statistics and I want to run power analyses on my models, so I was hoping to get some insight on model convergence issues. I am using a dataset in which I am examining the effects ...
30 views

### Three-way manova or separate anovas?

I have three independent catagorial variables and two dependent continuous scale variables, so I want to compare means across these three independent catagorial variables. I think here the best choice ...
27 views

### Power analysis: How do you calculate the power (1-B) based on the matched-pairs biserial correlation effect size?

I am running a Wilcoxon-signed rank test, and as suggested by King et al., the best effect size to report for this analysis would be the matched-pairs rank biserial correlation. How is the power (1-B) ...
68 views

### How to power a strong superiority hypothesis in an A/B test

Suppose I would like to perform an A/B Test, where it only makes sense to implement the "treatment" over the "control" if the "treatment" is atleast 2% better than the &...
71 views

### Is it incorrect to say that $\text{Power} = P(\text{reject } H_0)$?

Is it incorrect to say that $\text{Power} = P(\text{reject} H_0)$? I've seen in my textbook as well as other sources power is always defined as the conditional probability \$P(\text{reject } H_0 : H_a ...
1 vote