Linked Questions
74 questions linked to/from Relation between confidence interval and testing statistical hypothesis for t-test
1
vote
4
answers
367
views
Introductory Statistics, Hypothesis testing vs CI [duplicate]
Can someone please explain the difference between confidence interval and hypothesis tests.
For example in relation to estimating the mean, it seems to me that the main difference is that in a one ...
- 19
0
votes
1
answer
180
views
Trying to migrate from P values to CI... how to know when to reject null hypothesis? [duplicate]
So, I know that if we get a p<= 0.05 (95% CI), I know that the null hypothesis can be rejected. Now my question is how do I do that with CI?
Eg. in the table below A17S group has a CI of (27.835-...
- 577
1
vote
0
answers
158
views
Intuition For Overlapping Confidence Intervals and Statistical Significance [duplicate]
Two questions:
I have a really hard time with the intuition for why the second part
of this statement is true:
If two statistics have non-overlapping confidence intervals, they are
necessarily ...
- 34.2k
1
vote
1
answer
88
views
Interpretation of values contained in a confidence interval [duplicate]
Are the values within a confidence interval those that do not significantly differ from the point estimate? Or, put differently, how do we interpret the values contained in a CI given that the CI is ...
- 383
0
votes
0
answers
26
views
Consistence between: binomial confidence intervals, fisher test and power? [duplicate]
The Question is at the end of the reasoning.
1 : Representation of binomial confidence intervals:
We want to know if the proportion of reds in zone 1 is significantly different from the proportion of ...
- 11
1
vote
0
answers
18
views
Why do the confindence intervals overlap when my p-value is significant in meta-regression? [duplicate]
I fitted a mixed effects meta-regression model with one dummy-coded predictor (USA vs. Europe).
The output tells me that the predictor is significant. I then wanted to get the average estimated effect ...
- 21
1
vote
0
answers
10
views
Looking at the plot of two sample's distribution of means which are compared cannot reveal significance? [duplicate]
In practice we sometimes used a wisdom that two overlapping CIs for sample mean distribution meant we could not reject Hull hypothesis, to get a quick answer.
It looks though that this is a very raw ...
- 2,599
15
votes
8
answers
4k
views
Alternative graphics to "handle bar" plots
In my area of research, a popular way of displaying data is to use a combination of a bar chart with "handle-bars". For example,
The "handle-bars" alternate between standard errors and standard ...
- 12.1k
12
votes
8
answers
9k
views
If p-value is exactly 1 (1.0000000), what should the confidence interval limits be to support null hypothesis being true? [closed]
This is purely a hypothetical question. A very common statement is that $H_0$ is never true, it's just a matter of sample size.
Let´s assume that for real there is absolutely no measurable ...
- 735
24
votes
3
answers
13k
views
Safely determining sample size for A/B testing
I am a software engineer looking to build an A/B testing tool. I don't have a solid stats background but have been doing quite a bit of reading over the last few days.
I am following the methodology ...
- 683
14
votes
3
answers
15k
views
Can you explain why statistical tie is not naively rejected when $p_1-p_2 < 2 \,\text {MOE}$?
I need help explaining, and citing basic statistics texts, papers or other references, why it is generally incorrect to use the margin of error (MOE) statistic reported in polling to naively declare a ...
somebody
11
votes
3
answers
2k
views
Why is mean ± 2*SEM (95% confidence interval) overlapping, but the p-value is 0.05?
I have data as two lists:
...
- 9,507
13
votes
2
answers
767
views
What fraction of repeat experiments will have an effect size within the 95% confidence interval of the first experiment?
Let's stick to an ideal situation with random sampling, Gaussian populations, equal variances, no P-hacking, etc.
Step 1. You run an experiment say comparing two sample means, and compute a 95% ...
- 19k
1
vote
1
answer
31k
views
How is the 95% in 2 standard deviations above different than 95% confidence interval?
Is there a difference between the two uses of 95% in:
mean + 2 standard deviations (statistically significant)
confidence interval
- 125
7
votes
2
answers
2k
views
Why is standard error sometimes used for "error bands" in plots?
It seems that often what someone really wants to plot is a confidence interval of some kind, but using SE for this purpose I think only ends up comprising something like a 68% confidence band. ...
- 6,907