An inquiry into the quality of a statistical test by calculating the power - the probability of rejecting the null hypothesis given that it is false - under certain circumstances. Power analysis is often used when planning a study to determine the sample size required to achieve a nominal level of ...

learn more… | top users | synonyms

0
votes
0answers
6 views

Power Analysis for 1-sample Longitudinal Observational Study

I need to calculate the minimum detectable effect given a known N and desired power. I have a CONTINUOUS EXPOSURE and continuous outcome, each measured twice (baseline + 1 follow-up). If possible, I ...
0
votes
0answers
6 views

what is the difference between generalizability theory and power analysis

Genearalizability theory, especially the decision study(D study), sounds very similar to Power analysis. A D study uses the variance components from previous variance composition of the measurement ...
0
votes
2answers
41 views

Calculating power of a sample (need a layman's/beginner's definition)?

We have a bi-annual survey and an intended sample size of 1,300. This sample size was determined using Krejcie's means formula for finite populations, and we drew the sample using 2-stage clustering. ...
0
votes
0answers
18 views

G*Power post hoc power analysis , unequal sample sizez

I am conducting post hoc power analysis using G*Power. The test conducted was Anova, fixed effects, one-way, with one control and two test groups. Control had 25K records, each of the test groups had ...
1
vote
0answers
20 views

Sample Size Formula for Wilson Score, Clopper Pearson, and Jeffrey's

I am interested in finding the sample size formulas for proportions using the Wilson Score, Clopper Pearson, and Jeffrey's methods to compare with the Wald method. Also if anyone has code to replicate ...
0
votes
0answers
6 views

Parameter recovery study for a computational model: assessing model slopiness and practical implications

Consider a decision-making computational model with 6 free parameters. The model mimics human behavior: for a given decision-making task, it generates decision times and accuracy. For each parameter, ...
0
votes
0answers
47 views

Linear mixed model with repeated measures sample size

I have a pilot study about testing 2 drugs and a control (placebo) to see which drug is more effective. The design is as follows: Drug 1 is given to 5 random people then the response is measured 5 ...
0
votes
0answers
49 views

Estimation of the probability of the winner's curse

The increase in false-positive results arises primarily from an overestimation of effect sizes, leading to upward-biased effect sizes that often cannot be reproduced in follow-up studies (‘the winner'...
2
votes
1answer
30 views

Power Calculations using “Percent Change” vs. “Absolute Values”

Percent change can be extremely misleading for a number of reasons (e.g. regression to the mean), even though in the medical literature percent change is used quite frequently to "normalize" clinical ...
1
vote
1answer
35 views

How to perform a power analysis in this case?

I want to know how to perform a power analysis in the following case to know if my sample is good enough or not. In my faculty, we have decided to apply a new lecturing methodology to a set of ...
0
votes
0answers
7 views

Formula to convert test-retest reliability into SD of difference

Wanting to work out the statistical power of a repeated-measures t.test. This requires an estimate of the SD of differences within pairs (the correlation between measures for a given person is what ...
1
vote
0answers
24 views

a priori power analysis for ANOVA plus post hoc test

I would like to perform an a priori power analysis to calculate required sample size for data to be analyzed using one way ANOVA and Tukey HSD post hoc test. (I want to determine pair-wise which ...
1
vote
0answers
42 views

CFA power analysis using existing Likert-type data with lavaan and simsem in R

To preface, this is my first foray into CFA and SEM, so please forgive me as I am likely making a number of unwitting mistakes. I am currently working on a study to validate a proposed psychometric ...
1
vote
0answers
23 views

Determining sample size using power analysis in multiple testing context

I am currently trying to determine the required sample size for an experiment. As I want to use the statistical power concept (for a t-test) to determine the required sample size, I want to specify a ...
1
vote
1answer
52 views

Unequal Sample Size Effect on Power Calculation

I am new to power analysis and have been experimenting with one-way fixed effects Anova in G*Power (Fixed effects, omnibus, one-way, Post hoc power). When dealing with unbalanced design, the effect ...
0
votes
0answers
34 views

Different sample sizes, skewed data and unequal variances

I am a bit confused regarding best statistical test to use for my data. Here is the details: I did a study to compare two independent groups; 31 patients and 60 healthy controls. I have around 50 ...
0
votes
0answers
17 views

Multilevel Power of a Mixed Model

For my dissertation I have data from 57 employees that responded the same survey on 11 occasions (i.e., 11 observations per person for each variable). All variables I am interested in (and are ...
0
votes
0answers
7 views

Power analysis for two-sided non-compliance

Using Chamber of Commerce data for a small town, a local non-profit wants to evaluate the effectiveness of direct mail vs. email for getting business owners to contact the non-profit. We aren't ...
0
votes
0answers
15 views

Power calculation - categorised continuous exposure in case-control study

I have a continuous exposure that I would like to catagorise it into quantiles according to the distribution of control (i.e. 25% controls in each exposure level group). From pilot study, I know that ...
2
votes
1answer
32 views

Why does R power.prop.test & R prop.test show inconsistent results?

I am a bit confused by the differences I am seeing between R's power.prop.test & prop.test functions. To estimate the sample size needed for an A/B test I am conducting I am using the following ...
0
votes
1answer
47 views

Is there any conventional small, medium and large effect sizes for ordinal logistic regression?

I was performing a power analysis of articles published in a journal of management using the pwr package in R. However, it seemed to be impossible to compute power ...
1
vote
0answers
32 views

Interpreting pvalue in the light of known power

I'm puzzled with the interpretation of a pvalue in the light of known power Let's say I study the association between a dichotomic variable (a treatment) and a quantitative one, which is my primary ...
1
vote
1answer
35 views

number of participants to have a 80% chance of detecting a 1.5% point difference as significant

Can someone explain how the math used to determine that 34 participants were required for this study? To have an 80% chance of detecting a 1.5–percentage point between-group A1C difference as ...
0
votes
0answers
18 views

Best way to calculate power, precision & sample size using complex pilot data set?

I have a large and complex pilot data set of electromyographic (EMG) data collected from human subjects performing several different exercises. A single subject was used for all data collection in ...
1
vote
1answer
20 views

What, if anything, is the relationship between random intercepts models and compound symmetry?

In the analysis of correlated data, you're often working with replicates where a worker does a task 2 or 20 times, or an individual is measured for blood pressure randomly over several times during ...
1
vote
0answers
23 views

Is Mann Whitney U test appropriate for samples of really different sizes and distribution?

A Mann-Whitney U test on two samples of different sizes (Group A: 170,000) Vs. (Group B: 200), different distribution shape (as per Kolmogorov-Smirnov Tests ks.test ...
0
votes
0answers
14 views

Power calculation for panel regression

How do you perform a power calculation in a panel regression setting? In particular what do you use as your sample size. The number of individuals or the number of observations (individuals x time ...
1
vote
1answer
27 views

Measures of minimal detectable effect size

Statistical power is defined as the probability of wrongly accepting the null hypothesis for a given sample size, p-value cutoff and effect size. I am after accepted measures of the converse: the ...
0
votes
0answers
18 views

Power analysis for polynomial regression

There are two variables, $X$ and $Y$. I am interested in the shape of the relationship between $X$ and $Y$, specifically whether it is linear, curved, or some higher order polynomial function, because ...
1
vote
0answers
22 views

GAM or spline power analysis in R

There is a package in R called pwr. This is useful to make power analysis when designing the sampling of a project. here are few examples: ...
2
votes
1answer
407 views

How to find correlations between multiple low-frequency variables?

Let's say we have multiple ($k > 2$) binary variables (e.g., genetic mutations and/or disease states), which appear at a given frequency of $f(1)$ to $f(k)$ in a sample. We would like to test ...
2
votes
1answer
38 views

Some questions on multiple logistic regression

Let's say we have k binary (binomial) variables, and a sample size of n observations per variable, where each variable occurs (positive case) at a given frequency/probability f. We would like to check ...
0
votes
1answer
72 views

Power calculations Uniform(0,$\theta$)

I am working on this problem and got about halfway through it, before getting stuck. Could anyone take a look at it? here's my problem... $x_1,...,x_4$ are distributed $U(0,\theta), \theta>0$ ...
1
vote
0answers
83 views

Power Analysis By Simulation

Background: We have a developed an alternative website which we believe will increase sales by a small percentage (1-4%). Although small this is very valuable. Our Site: Visitors are tracked by a ...
0
votes
2answers
39 views

Statistical power of binomial vs. paired t-test

I am conducting an experiment and I am deciding whether to use a forced-choice paradigm (participants choose A or B), or a continuous rating paradigm (rate each stimulus A and B on a Likert scale). ...
1
vote
0answers
34 views

Barnard's Exact Test (Boschloo's variant) when distribution is hypergeometric

Let's say, we have a standard $2 \times 2$ contingency table and because of low sample size we're about to use some type of Exact Test, e.g. Fisher's Exact Test (FET) or Barnard's Exact Test. It's ...
1
vote
0answers
33 views

Determining the power associated with the logistic model

Although there has been some detailed discussions about power analysis on this website (for example here and here), the answer provided to this question has outlines the steps to simulating a power ...
0
votes
0answers
23 views

How to determine statistical power when I must use Welch's Robust Test of Equality of Means

I couldn't use a one-way ANOVA on my means comparisons (3+ groups) because I have heterogeneity of variance (and unequal group sizes), so I used Welch's Robust Test of equality of Means. Of all my ...
1
vote
0answers
13 views

Combination of Tests' Power

I have set of tests. It is not difficult to calculate power for each of them (I have normal distributions and know effect sizes). I would like to infer power of combination of tests. I.e., $H_0 = $ ...
0
votes
0answers
9 views

guidelines for repeated measures anova power

I has been requested to assess the power of a repeated measures analysis experiment: 11 subjects, one between subject variable (product, three levels) and one within subject variable (time, four ...
0
votes
0answers
22 views

Power Analysis for Within Subject ANOVA

I am going to be collecting survey data that asks for participants' attitudes towards four groups of people. For the sake of this example, let's say that it's black women, black men, white women, and ...
0
votes
0answers
28 views

Determining sample size of skewed data

I have seen questions asking about sampling with non normal data but did seem to help. I have two datasets, dataset A containing results of students before ...
0
votes
0answers
12 views

Clustering and power: increasing the n but not the number of clusters

I am designing an experimental study with N observations from M sampled clusters, where M << N. Half of the clusters will be assigned to treatment. I can spend more money to increase the number ...
2
votes
2answers
155 views

Post hoc power analysis for a non significant result?

I have submitted a paper to a journal reporting a non-significant finding. One of the reviewers has asked me to include a power analysis on my data to work out how big a sample size I would need to ...
1
vote
1answer
41 views

What do they mean by 'To calculate sample size, I use simulation in all cases.'?

I was looking for a book on sample size calculations and power analysis and I met this phrase 'I use simulation in all cases.'. What does it mean, can i forget about using traditional methods for ...
1
vote
0answers
26 views

Minimum sample size for 1-tailed hypothesis testing

Let's say we have some endangered species of animals, whose population is 10,000 and dwindling due to some disease they all carry. And say I want to be able to test the efficacy of some new drug (with ...
0
votes
1answer
106 views

How to draw the estimated power curve of a test?

The estimated power of a given test can be reported with a table or with a curve in a plot. I need to compare the power of two permutation tests by simulation and I was wondering how to create a good-...
0
votes
1answer
19 views

converting a chi-square with more than one degree of freedom into a pearsons r

I want to run a power analysis for a study using correlations between two continuous variables. Previous research with the variable I am interested in used a Kruskal-Wallis test to look at differences ...
0
votes
2answers
14 views

Prospective power using observed difference

In my line of research we often calculate prospective power of a proposed study as a way to determine what sample size we should aim for. However, I'm often studying phenomena, or interactions between ...
0
votes
0answers
22 views

Power of a binomial based test

I have a Bernoulli trial, which by definition can be either success of failure, and I have a Binomial random variable of the number of successes, where I don't know p (I wish to estimate it). I have a ...