# Tag Info

1 vote

### Confidence intervals when using stratified proportionate random sampling

With proportionate stratification, if you ignore the strata you will still get an unbiased estimate of $p$, but your confidence interval will (in general) be too wide. For binary data it's not likely ...
• 41.4k

### Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?

The misinterpretation of confidence intervals is related to what Blitzstein and Hwang (in their probability textbook) call "sympathetic magic". Sympathetic magic is an anthropology term for ...
1 vote

### Are all values within a 95% confidence interval equally likely?

Although the phrase “all values within the CI equally likely” is unclear in its meaning, it would seem to imply that our confidences in equal-length segments of the CI should be the same irrespective ...
Accepted

### confidence intervals for proportions containing a theoretically impossible value (zero)

It is not a problem. Confidence intervals display the range of values of estimates/hypotheses that are supported by the data. Or alternatively the values outside the interval are values that are ...
• 82.1k

### confidence intervals for proportions containing a theoretically impossible value (zero)

Stepping back from the complex discussion of statistical frameworks, the way I see your problem is: you want an interval-estimate of some probability, ie an interval estimate of some parameter ...
• 2,461

### confidence intervals for proportions containing a theoretically impossible value (zero)

The obvious solution when you have prior information is to take a Bayesian approach. Perhaps your prior knowledge can be represented via a beta-distribution, in which case things are super-simple from ...
• 33.5k

### confidence interval and rejection

Yes, you should consider providing both the p-value for your chosen null and a confidence interval. The mathematical link between hypothesis testing and confidence intervals should not drive your ...

### confidence interval and rejection

YES I would consider this a best-practice. While you are correct to recognize the relationship between hypothesis testing and confidence intervals, the confidence interval gives a range of "...
• 64.7k
Accepted

### Worst-case analysis using confidence intervals

Your intuition that you are double counting the uncertainty is indeed correct. What you are looking for is a Tolerance Interval, that is a confidence interval for a proportion. Let's assume that your ...
• 1,757

### How to actually use the Empirical Influence Function for BCa Bootstrap Intervals?

I have managed to figure out the answers to some of my questions but I am still at a loss with how to work with the empirical influence function itself. Luckily, I think I can now just rely on ...
• 51

### Can MAE be interpreted as the average standard deviation around the true value of a prediction?

the rule of thumb is that 95% of data should fall between two standard deviations of the mean value. The estimate of the standard deviation is different for MAE compared to RMSE. The unbiased ...
• 82.1k
Accepted

### Prediction bands for weighted linear regression

Let's assume the data come from the following heteroskedastic normal simple linear regression model, wherein the unit weights $w_i>0$ are known (even for future observations):  y_i = \alpha+\...
• 2,248

### Confidence intervals vs. standard deviation

My answer focuses on the distinction between estimation and prediction. With the interval (mean) +/- 2*(std deviation), you predict that about 95% of the data will fall in this interval (with the ...
• 20.7k

### Intercept significant, but confidence intervals around its standardized β include 0

This is unsurprising: The intercept $p$-value tests whether the outcome differs significantly from $0$ when all explanatory variables equal $0$. Using scale on ...
• 12.6k
Accepted

### Extract credible/confidence interval of a threshold in a Bayesian posterior draws distribution

Your posterior belief for the b_mpg variable is that is 99.61 percent likely to be higher than 0. There is no confidence interval for that number, this is the ...
• 3,889
Accepted

### Predicting cost for several options and then choosing the cheapest option

So I am assuming that you are interested in total( ie sum) cost saving . this can be analysed as the average over orders of (cheapest predicted cost - actual cost) saving = (actual cost - model cost )...
• 7,258
While I can sympathize with the wish for an uncertainty measure for AIC, the larger issue is that AIC like model likelihood ratio $\chi^2$ is proportional to the sample size. So as $N$ gets larger, ...