Questions tagged [statistical-power]

Is a property of a hypothesis testing method: the probability of rejecting the null hypothesis given that it is false, i.e. the probability of not making a type II error. The power of a test depends on sample size, effect size, and the significance ($\alpha$) level of the test.

Filter by
Sorted by
Tagged with
1 vote
1 answer
25 views

power and sample size estimation

For a one-sided test: $$H_0: \mu_1 \leq \mu_2 \ H_1: \mu_1 >\mu2$$ $$\alpha=0.025,\beta=0.1$$ How to calculate the sample size needed? Is this information enough to calculate the sample size?
user avatar
3 votes
3 answers
75 views

P-value under 5% but power under 80%

Im trying to understand how to accurately report results on AB tests If my type 1 error is 5% and type 2 is 20% , can we have instances where the p-value is < 0.05 and power is < 0.8? If so, how ...
user avatar
0 votes
0 answers
8 views

Calculate sample size for multiple treatments vs control, given the proportion mix of treatments

I want to know what my sample sizes should be for each of my treatments and control, given a proportion mix between the groups. For example, let’s say I have 3 treatments (A, B, C) and 1 control (D). ...
user avatar
0 votes
1 answer
13 views

Sample size calculation for Cox regression with time-varying exposures

I'm involved in the design of a longitudinal observational study investigating a relationship between the use of a drug and a binary outcome. Participants are enrolled when at risk of the outcome, ...
user avatar
  • 101
0 votes
0 answers
29 views

Power / sample size estimation for chi-square test with continuity correction in R

1._Some authors mention that they estimate sample size for chi-square test with continuity correction. For instance: Sample-size calculation is based on Pearson's Chi-square test with a two-sided ...
user avatar
  • 883
1 vote
0 answers
18 views

How to deal with ragged power curve

I am exploring various methods for sample size calculation and power analysis from binomial data, and frequently coming up against ragged power curves that go up and down as sample size increases. I ...
user avatar
0 votes
0 answers
9 views

Questions for calculation power/sample size in (multi group) structural equation modeling

I will measure a certain characteristic in an intervention group and in a control group over four points in time. I want to construct a latent change score model to check if the groups develop ...
user avatar
  • 111
9 votes
3 answers
605 views

Report power if result is statistically significant

We have submitted a paper reporting a statistically significant result. One reviewer asks us to report what is the power to detect a significant association. As there was a previous paper on this ...
user avatar
  • 111
1 vote
1 answer
25 views

Error in wp.logistic: ‘p0’ must be numeric in (0,1)? What to do when p0 is negative?

I am trying to find out the sample size I need for a future study using a reanalysed existing dataset to enter the values in a WebPower script. I am using the intercept and odds ratio/estimate of my ...
user avatar
-1 votes
0 answers
11 views

Power with a hierarchical multiple regression analysis [duplicate]

I was wondering how to calculate the power with the below data? I did a hierarchical multiple regression with two models. There are a total of 87 participants and the alpha level is 0.05.
user avatar
-1 votes
0 answers
11 views

How to calculate your power in GPower? [duplicate]

I was wondering how you calculated the power via Gpower with these results? There are a total of 87 participants and the alpha level is 0.05.
user avatar
0 votes
0 answers
41 views

How to calculate power?

I was wondering how you calculated the power via Gpower with these results? There are a total of 87 participants and the alpha level is 0.05. It is a longitudinal design in which I performed a ...
user avatar
2 votes
1 answer
66 views

Post hoc power analysis for multilevel regression analysis

I have a multilevel model with 2 levels (L1 = individuals, at least 710 per country; L2 = countries, 17 total) ...
user avatar
  • 1,448
1 vote
0 answers
14 views

How to Ensure Saturation Using Grounded Theory?

In quantitative causal inference, we do power analysis to determine the minimum sample size to achieve (1 - $\beta$) statistical power of our hypothesis test with a specific $\alpha$ statistical ...
user avatar
2 votes
0 answers
85 views

When the anticipated sample size is not reached in a clinical trial

How to justify precisely a situation where the expected sample size is not reached? For example, the sample size for our study protocol was determined on the basis of a fixed statistical power of 80%. ...
user avatar
0 votes
0 answers
3 views

repeated measures design vs. MANOVA power analysis

My collaborator and I are building a study where participants will read some profiles that vary for 3 dimensions each having 3 levels (9 profiles in total). For each profile participants will have to ...
user avatar
0 votes
1 answer
36 views

Power issue for categorical vs. continuous predictor in lmer

I have the following model: ...
user avatar
1 vote
2 answers
34 views

Does StatsModels' power.tt_ind_solve_power assume a single standard deviation despite two different means?

Does StatsModels' power.tt_ind_solve_power (link) assume a single standard deviation despite two different means? I think so. Why is this a reasonable assumption? I come from a primarily Bayesian ...
user avatar
  • 1,700
1 vote
2 answers
55 views

Question regarding post-hoc power analysis

I am having trouble with interpretation of a prospective superiority randomised controlled trial. Study characteristics: Study design: Alpha value = 0.05 1-beta = 0.8 Predicted effect size =0.15 [P1 =...
user avatar
  • 11
1 vote
0 answers
19 views

Required sample size of CFA using power analysis from semPower

I want to conduct a confirmatory factor analysis (CFA) for a model with 4 latent variables and 60 indicator variables (15 per factor, uncorrelated factors, hence 1,710 degrees of freedom, that is, ...
user avatar
1 vote
3 answers
52 views

Python package for this power analysis calculator [closed]

I would like to use the following power analysis formula into a python notebook https://clincalc.com/stats/samplesize.aspx Any idea which python package would replicate the same results ? Edit: I ...
user avatar
0 votes
0 answers
19 views

Convergence algorithm for power analysis?

I found this algorithm on a shared drive and I'm really curious how it works. From appearances, it's used to estimate the MDE in power analysis when the effect size (difference of proportion means) ...
user avatar
  • 1,700
0 votes
0 answers
37 views

Calculating Sample size of a linear regression

I just would like if anyone knows how to calculate the sample size for the data set given the significance level is set at alpha = 0.05 and the power of the test should be 80%. The linear regression ...
user avatar
  • 1
0 votes
0 answers
13 views

GLMM: X=Non integer warnings for power estimation

For starters I am both new to R and out of practice for statistics. I am going to run an experiment where participants answer a survey every day for a week, and I want to figure out the sample size I ...
user avatar
2 votes
1 answer
23 views

power analysis via Monte Carlo when effect size, means, and std unknown

Say you want to execute an experiment to see whether a treatment is better than a control and want to properly power your experiment. However, you have no beliefs a prior regarding the treatment's ...
user avatar
  • 1,700
0 votes
0 answers
29 views

Calculating the power of an experiment

I'm working through a question in Gelman - Regression and Other Stories and I find myself getting confused with the following question; 'Power, type M error, and type S error: Consider the experiment ...
user avatar
0 votes
0 answers
39 views

Most powerful test for hypothesis testing with uniform and exponential distributions

Given sample of single observation $x_{[1]}$, we are checking hypothesis $H_0 \sim U[0, 1]$ versus $H_1 \sim Exp(1)$. I need to find most powerful test for hypothesis checking with given Type I error ...
user avatar
  • 201
1 vote
1 answer
32 views

low sample size experimental design, t-test vs one way ANOVA

I'm designing a biological experiment wherein the sample size is very limited, as each sample is very hard to get. Moreover, I need to have 4 independent groups, each receiving a different treatment. ...
user avatar
  • 73
0 votes
0 answers
21 views

Power estimation and analysis for multiple 3x3 count tables

In my design, each subject produces a 3x3 contingency table.So I have a table of counts of how many times a subject responded X Y Z in condition A, B or C. All the columns sum up to 50 (num of trials ...
1 vote
1 answer
31 views

How to calculate how many levels of nuisance factor I need for a desired power level in my experiment

I have a nuisance factor that introduces a lot of variation in my data. I want to know how many levels of this factor I need to include in my blocked design to get a power level of, say, 90%. As an ...
user avatar
0 votes
0 answers
24 views

Compare mean of subsamples between groups

I am going to collect quantitative data for two groups that I would like to compare. I have done a two sample t-test on some preliminary data and found a significant difference, but I don't think that ...
user avatar
  • 1
1 vote
1 answer
34 views

Computing the power for binomial regression with indicator variables

My question is kind of a sequel to this one. For an experiment I'm designing, I want to model the outcomes by a binomial regression, something like ...
user avatar
  • 6,283
2 votes
1 answer
34 views

What is the purpose of accrual period in survival analysis?

Before reading the answer to this question, I, like the original poster, thought that we have to take the accrual period into account because some subjects might die before we start the treatment. But,...
user avatar
  • 6,283
0 votes
0 answers
17 views

Mixed Model Convergence Issues With LMER

I am fairly new to statistics and I want to run power analyses on my models, so I was hoping to get some insight on model convergence issues. I am using a dataset in which I am examining the effects ...
user avatar
  • 1
0 votes
0 answers
16 views

Three-way manova or separate anovas?

I have three independent catagorial variables and two dependent continuous scale variables, so I want to compare means across these three independent catagorial variables. I think here the best choice ...
user avatar
  • 57
0 votes
0 answers
16 views

Power analysis: How do you calculate the power (1-B) based on the matched-pairs biserial correlation effect size?

I am running a Wilcoxon-signed rank test, and as suggested by King et al., the best effect size to report for this analysis would be the matched-pairs rank biserial correlation. How is the power (1-B) ...
user avatar
0 votes
1 answer
58 views

How to power a strong superiority hypothesis in an A/B test

Suppose I would like to perform an A/B Test, where it only makes sense to implement the "treatment" over the "control" if the "treatment" is atleast 2% better than the &...
user avatar
  • 331
0 votes
2 answers
70 views

Is it incorrect to say that $\text{Power} = P(\text{reject } H_0)$?

Is it incorrect to say that $\text{Power} = P(\text{reject} H_0)$? I've seen in my textbook as well as other sources power is always defined as the conditional probability $P(\text{reject } H_0 : H_a ...
user avatar
1 vote
1 answer
50 views

Statistical power of tests on unequal and known variances vs equal but unknown variances

Suppose you are testing for differences in two normally distributed variables. In the following situations: -Variables have known but unequal variances -Variables have variances that are unknown but ...
user avatar
  • 11
0 votes
0 answers
8 views

How to get within standard deviation in mixed models

I wonder how to get the within standard deviation in mixed models. Does anyone have an explanation? If not in mixed models, how would it otherwise be done? Thanks! ...
user avatar
0 votes
1 answer
41 views

What is the different between t(3) and Ca(0,1) distributions

I did a simulation study for empirical power for normality tests Shapiro-Wilk test and Anderson-Darling test against alternative t(3) and Cauchy distribution with parameters 0 and 1, I know both are ...
user avatar
0 votes
1 answer
30 views

Is there any reference justificating a P<0.10 as a cutoff for likelihood-ratio tests?

I am conducting log-likelihood-ratio tests to examine the goodness of fit of two competing logistic regression models. The test is the traditional log-likelihood-ratio test, in which I compare the ...
user avatar
  • 59
0 votes
1 answer
37 views

Baffling results in the simulation of a power analysis of a sequential, online A/B experiment

I conducted a simulation that had baffling results and would love your help understanding. Context: I want to estimate the required sample size to detect a difference in proportions for a sequential, ...
user avatar
  • 113
1 vote
0 answers
51 views

Why do we need statistical power? Why are p-values not enough?

I am looking to understand the need and intuition for statistical power. I understand how to calculate it, but I cannot understand why we need it. Here is my current thinking: Suppose we have a ...
user avatar
  • 331
0 votes
0 answers
33 views

How to perform statistical power analysis for generalized linear models on IBM's SPSS?

I ran a generalized linear model (Poisson distribution) on some data of mine. This is my simplified syntax: ...
user avatar
0 votes
0 answers
30 views

How to do power calculations for secondary analysis?

I am conducting a secondary analysis on a study with 3k participants. My analysis is stratifying the data to look at another outcome of interest. One of my editors has told me to conduct a power ...
user avatar
0 votes
0 answers
23 views

How do I asses the power of a chi-squared test of independance?

Let's suppose I have two treatments, A and B, that I use on randomly sampled individuals of a population. I want to assess the relation between the treatment and the probability of an event happening ...
user avatar
1 vote
0 answers
40 views

Is it better to have many measurements each with few data points or few measurements each with many data points?

I've wondered this for a long time. Let's say that I'm designing an experiment e.g. to measure human reaction time to images in which the contrast is varied. If I can afford 1000 trials I could make ...
user avatar
  • 111
0 votes
0 answers
16 views

Cohen-d issues with pingouin ttest function for paired samples

I have two lists of time values, 'times0' and 'times1'. The data are paired (first value in times0 is paired with first value in times1, second value idem etc etc). I want the cohen-d of the t-test ...
user avatar
  • 1
0 votes
1 answer
34 views

Calculate power-effect size relationship for difference in difference of proportions

I am trying to conduct power calculations for a "Before-After-Control-Impact" type of study focused on public opinion variables. Ideally, I want to look at the relationship between effect ...
user avatar

1
2 3 4 5
28