# Questions tagged [confidence-interval]

A confidence interval is an interval that covers an unknown parameter with $(1-\alpha)\%$ confidence. Confidence intervals are a frequentist concept. They are often confused with credible intervals which is the Bayesian analog.

4,333 questions
Filter by
Sorted by
Tagged with
33 views

### Why do the bootstrap calculated p-value and the confidence intervals seem to contradict each other [R code, specific example]?

Below you'll find the data and the corresponding R code used to perform the bootstrap hypothesis test to compare the ratio of the means of two samples and additionally, to estimate the 95% confidence ...
• 133
19 views

### How to manually calculate p-values for lmers?

Hopefully this is not a duplicate. Provided the t-statistic, SE and 95% CI, how can I manually calculate p-values for lmers in R? More details in the quoted link below. I've used ...
• 615
1 vote
52 views

### p-values and confidence intervals are not matching

My model is here. I'm running a bootstrapping mixed-effects model with "case" type with lmersmapler. The thing is, now I'm using bootstrap_pvals()to ...
• 615
21 views

### How do we report significant tests without p-values? Reliance on confidence intervals

I'm pretty much reporting these results. I've bootstrapped my sample using lmersampler, which does not provide p-values for bootstrapped models. I relied on confidence interval boundaries to justify ...
• 615
15 views

### Incorporating denominator uncertainty into a proportion

I am calculating an incidence risk (r): number of cases of a disease in a population over one year (c) divided by the total mid-year population (N). $$r = \frac{c}{N}$$ Let's assume that c is a ...
• 103
59 views

### Confidence interval for logistic regression in R

After logistic regression analysis using gtsummary package in R, I got p-value, odds ratio and 95% confidence interval as below With the p-value>0.05, however, 95% CI did not include 1. When ...
• 31
14 views

### How to properly use the target of one regression model as a feature in another model?

I created a SVM model which predicts one target. I then used the percentiles of the residuals from the test set to define the distribution of the prediction error (normal with 0 mean and $\sigma$ ...
• 23
6 views

### Codes/Commands for estimation of Marginal Expected Shortfall (MES) and SRISk [closed]

I need codes/commands to estimate marginal expected shortfall (MES) and SRISk. Thanks Shakeel
20 views

1 vote
33 views

### Hypothesis testing using samples with different measurement errors/intervals

Are there generalizations of common hypothesis tests (e.g. t-test, mann-whitney) that can take into account different confidences in the sample measurements? For example, if I have two sets of ...
• 111
27 views

### Is it possible that a confidence interval for a sampling distribution of the sample proportion to be < 0 or > 1? [duplicate]

A proportion or percentage must be between 0 and 1, therefore, a confidence interval for a proportion should also be between 0 and 1. But is it possible that if the "10-successes-and-10-failures&...
• 101
27 views

### Central Limit Theorem and Confidence Interval

Let $\{X_n\}_n$ be a sequence of i.i.d. RV's, where each $X_n$ is a copy of RV $X: \Omega \rightarrow \mathbb R$. For $n > 0$, I can define $\bar X_n := \frac{1}{n}\sum_{i=1}^n X_i$. Then, central ...
• 141
27 views

### Meaning of 95% confidence interval [duplicate]

If I take a 95% confidence interval $I_k$, then it means that if I sample 100 confidence intervals $\{I_1, \cdots, I_{100}\}$, then it is expected that 95 of $I_k$'s contain the true parameter. Of ...
• 141
31 views

### Calculating confidence Interval for a return time curve, via non-parametric bootstrapping

I have some precipitation data (yearly extremes), which I have fit with a Gumbel distribution (CDF), from which I have calculated a return time distribution. I want to calculate the 95% confidence ...
• 21
26 views

### If a confidence interval and test error are both expressions of a margin of error, why do we need both?

Let's say: We have a population consisting of $N$ units, of which we take a sample of $n$ observations. For simplicity, this will be a bivariate dataset $(X, Y)$, whose true population is best ...
1 vote
21 views

### Amplification effect of retweets on uncertainty

Consider you are scoring tweets for tone based on some sentiment analysis implementation. Each tweet has hypothetically a 90% chance of being correctly scored, while 10% get it wrong for whatever ...
• 587
29 views

### Updating a team's REAL ability

I am trying to think of a math appropriate way to describe the “real” talent of a team. This stems from looking at the probabilities of each team winning the Super Bowl. Let me illustrate with a ...
• 21
1 vote
31 views

### Sample size calculation to bound CI around a true value

I'm working on a cold start system for a recommender system - Whenever I have a new item, I need to show it to users enough times to get a somewhat accurate estimate of CTR, and then I will let the ML ...
• 113
21 views

### How can I calculate the prediction intervals using bootstrap? [duplicate]

I have trained a linear regression model based on some data. Now I have new data, and I need to find a way to calculate the CIs for each $Y_{new}$ sample. Meaning now I have ...
22 views

• 844
20 views

### Statistical parameter differences when one model is specified but confidence intervals overlap?

I have two (classically) estimated coefficients from 2 different models, $\alpha_{m1}$ and $\alpha_{m2}$, say, with 95% confidence intervals. I maintain that model m2 is mis-specified and that the ...
• 1
16 views

### How to find the confidence interval for a new Y point? [duplicate]

In a linear regression model, as Y is the target and X are predictive features,the CI for $E[Y_{new}|X_{new}]$ is as follows: Assuming $X_{new}$ is given, $X_{new}$ is the new data given for a target ...
1 vote
53 views

### Creating an Example to Teach "Confidence Intervals" [duplicate]

Usually, people tend to confuse the interpretation of confidence intervals. The following two statements are said to be quite confusing (even to myself): A 95% Confidence Interval means that the ...
• 6,916
1k views

### Why Aren't "Non-Informative Priors" More Popular?

Recently, I have been reading about how Confidence Intervals in the Frequentist setting are often misinterpreted (e.g. The importance of a correct interpretation of a confidence interval). Supposedly, ...
• 6,916
1 vote
21 views

### When calculating the variance of the sampling mean, if we know there is a mean-variance relationship, can we exploit that information?

My statistic is the sampling mean of a ratio statistic (call it $Q$). In my case, I know that the variance of the sampling mean is correlated with $Q$. So, for example, if the standard error is > 4,...
76 views

### Which definition of confidence interval is correct, or are they the same thing?

Wondering 1) which of the two ways of calculating confidence intervals is correct, and 2) if they both are correct, are they the same or different? How do they reconcile? CI = [Coef x1 ± 2*SE(coef x1)...
• 402
26 views

### A/B test : Confidence interval for Revenue per Visitor using Conversion Rate and Average Price per Order

I have an A/B test to improve number of orders. The result came back showing a positive impact on the number of orders per visitors (aka, Conversion Rate) but not significant on the average revenue ...
54 views

### How to interpret a "% win probability"?

I came across this explanation about a 61% win probability: 61 percent should be interpreted as: “if these teams played 100 times, we would expect Marquette to win 61 of those games.” It definitely ...
• 343
59 views

Is there an intuitive way to remember if we get an upper bound or lower bound for a parameter when inverting a one-sided hypothesis test? In Casella & Berger, it is written: If we have $H_0: \mu = ... 0 votes 0 answers 15 views ### Confidence interval for$R^2$in a panel VAR I know it is possible to compute the confidence interval for$R^2$. An answer to this question on CrossValidated references this blog post with the Equation:$$SE_{R^2} = \sqrt{\frac{4R^2(1-R^2)^... • 183 0 votes 0 answers 6 views ### Calculating difference in means confidence interval using only standard errors, sample sizes, and means I use a complicated survey-corrected estimator to calculate a mean and standard error for one year and then redo the process to calculate a mean & se for another year (using IEA education data ... 0 votes 1 answer 54 views ### Confidence regions from a Gamma distribution Let a random variable with posterior distribution be given by$X \sim \textrm{Gamma}(10,12)$. This is the result of Jeffreys prior$\pi_J(\lambda)$multiplied by the Likelihood of i.i.d.$X_1,...,X_n \...
• 107
1 vote
I am trying to determine the area of the ellipse which contains the true mean of $(X_n, Y_n)_{1\leq n \leq N}$ with a probability of 90%. The 90% confidence ellipse area, or C90 area. The sample ...