Questions tagged [prediction-interval]
A prediction interval (also forecast interval) is an interval that covers the future (or otherwise unknown, but *observable*) value of a random variable with some prespecified probability.
232
questions with no upvoted or accepted answers
12
votes
0
answers
2k
views
Empirical Prediction interval for time series forecast based on quantile regression
As Gardner notes "almost all point forecasts are wrong", so prediction intervals (PI) are necessary to quantify uncertainty and help us make informed decisions. There exists theoretical PI, and in ...
10
votes
0
answers
1k
views
Bootstrap Prediction Interval: which residuals to use and which method?
I ask this question referring to the post: Bootstrap prediction interval, where a step by step method for calculating the prediction interval for linear regression models is explained.
In the ...
8
votes
0
answers
1k
views
Detecting outliers using 95% PI around a natural spline fit
Please see the picture below:
I wanted to mark the points that are not consistent with their adjacent points as outlier. What I did was to fit a natural spline fit to 1000 observations (the purple ...
7
votes
0
answers
507
views
Is it possible to get a prediction interval for logistic regression via a latent variable?
carbocation asked how to compute prediction intervals for logistic regression. The answer was that prediction intervals don't make sense for logistic regression because the response variable only ...
7
votes
0
answers
719
views
prediction interval of a new prediction out of a weighted linear regression model
This question is based on the example 11.1 out of the book Applied linear statistical models of Kutner, Nachtsheim, Neter and Li. You can find the data here.
First they calculate a simple linear ...
5
votes
0
answers
1k
views
Prediction intervals for generalized least squares model with heteroscedastic errors
I wanted to model some data with heteroscedastic errors using a gls model of the form
...
5
votes
0
answers
903
views
Prediction intervals for HTS forecasting
So I have a lot of time series with a hierarchical structure, and need to produce forecast for each base series and its aggregates by the hierarchical structure.
I have decided to produce forecast ...
5
votes
0
answers
254
views
What is the mathematics behind the GAM prediction intervals?
From the R gam function available in the gam and mgcv package there is the option to obtain ...
5
votes
0
answers
367
views
Derivation of prediction intervals for a normally distributed population with unknown population standard deviation
I have via the ISO standard 16269 found the solution to a problem that I've been working on. Based on a couple of independent samples from a normally distributed population, I would like to determine ...
5
votes
1
answer
660
views
Is this interpretation of prediction intervals correct?
I have a regression model relating to a ''normal'' population. If a new observation which corresponds to point $x$ is outside the prediction interval at $x$, do I have a reason to suspect the new ...
4
votes
1
answer
136
views
Confidence interval for (unobserved) sample mean
Suppose I take two samples, $a$ and $b$, from a population (or super population) but that I only observe $b$. However, I want to construct a confidence interval for $\bar{a}$, the average of the ...
4
votes
1
answer
196
views
How to test whether 2 prediction intervals are statistically different?
I've been struggling with this for a while now, hopefully someone will know how to help me :)
Here it is :
1) I'm using a linear mixed effects model on longitudinal data (biological values of many ...
4
votes
1
answer
771
views
Prediction Interval for Mean of Predictions
This question is about creating a prediction interval for the mean of predictions from a regressor.
Let's say I have arbitrary regression function (not necessarily parametric, could be random forest, ...
4
votes
0
answers
444
views
Prediction interval for function of binary outcomes in GLM
I have a large data set with binary outcomes $\vec{y} = (y_1,\dots,y_n)$ with $y_i\in\{0,1\}$ and covariates $\mathbf{X} = (\vec{x}_1, \dots ,\vec{x}_n)^\top$. One of the goals of the model I am ...
4
votes
0
answers
821
views
Bootstrapped prediction intervals: Quantile, median, SE...?
I am trying to construct prediction intervals for a non linear model via Boostrap. What I do is to apply the usual bootstrap procedure, here you have pseudo-code for 1000 iterations:
...
4
votes
0
answers
223
views
Prediction Intervals for Incremental OLS regression
I am implementing incremental OLS regression algorithm where the data points arrive one at a time. As the regression parameters are determined by the formula, $(X'X)^{-1} X'y$ and the Sherman-Morrison ...
4
votes
0
answers
468
views
Prediction Intervals for Robust Regression: Formulation and are they larger than for OLS?
I have created regression models using robust regression - in particular, LTS and MM-estimators (using the R package robustbase). I am now looking to creation prediction intervals.
The standard ...
4
votes
0
answers
369
views
How do I compute a prediction interval from generalized estimating equation output?
Suppose I have repeated observations on individuals, which I've analyzed using a generalized estimating equation (GEE). What is the procedure for computing the prediction interval for future ...
4
votes
0
answers
951
views
prediction interval for heteroscedastic data
Here are some data:
...
3
votes
1
answer
75
views
Prediction intervals and bias-variance tradeoff
I was looking for literature which connects prediction intervals with the bias-variance trade-off.
Obviously both concepts deal with describing a mean squared deviation: the bias variance tradeoff ...
3
votes
0
answers
219
views
Ways to estimate error in a machine learning algorithm's predictions by outputting a probability distribution
I want to make it so that my machine-learning algorithm, when given an input, outputs the parameters of a Gaussian distribution, with the goal of getting an expected error on the prediction.
The ...
3
votes
0
answers
51
views
(G)LM prediction interval with heteroscedasticity
I am trying to get prediction intervals from some non-linear data which also exhibits heteroscedasticity.
...
3
votes
0
answers
39
views
Predicting the variance of a future sample
Suppose that I have the dataset for wealth distribution for 50 different countries. Each country's data consists of the wealth figures for 100 random individuals in that country. Some countries have ...
3
votes
1
answer
378
views
95% prediction interval for an ARMA(2,2) model
What would the formula for a 95% prediction interval for an ARMA(2,2) model be?
The specific model I am using is: an ARIMA(2,0,2) with non-zero mean, with the following parameter estimates:
...
3
votes
1
answer
59
views
How to test whether individual fits to regression line or not
I have a defined regression model for the healthy control (HC) group, with corresponding CIs of coefficients and of E(Y).
I would like to test whether individuals belonging to another population (...
3
votes
0
answers
339
views
Is a comparison between Bayesian and frequentist prediction intervals sensible?
I am aware that frequentist confidence intervals and Bayesian credible intervals have quite different interpretations, and are not comparable.
I'm wondering if the same is true for prediction ...
3
votes
0
answers
242
views
infinitesimal jackknife confidence intervals for bagged learners are NOT prediction intervals, right?
Wager, Hastie, and Efron present a method for computing confidence intervals for RF predictions.
Confidence intervals have to do with the variability of the expectation, not the expectation of the ...
3
votes
1
answer
43
views
Using clusters to estimate model variance
I am working with a blackbox prediction model which takes known inputs and outputs a single mean response. I know this model's residuals to be heteroskedastic, but also can assume the error term of ...
3
votes
0
answers
410
views
How to get prediction interval given non normal data?
I'll start by saying that I have very little background in statistics and that my question title above is probably worded incorrectly. If I need to change the title to more accurately reflect my ...
3
votes
0
answers
922
views
Precision of Prediction Intervals for Multiple Linear Regression
As discussed in 33433, the prediction interval for single linear regression is most precise at the mean of the $x$ values. Does this also hold true for multiple linear regression, that is: the ...
3
votes
0
answers
441
views
How to calculate prediction intervals based on Chebyshev inequality?
I have recently read the article by Gardner (1988) who proposes Chebyshev inequality-based prediction intervals for forecast:
suppose we have a model selected on the usual basis of one-step-ahead
...
3
votes
0
answers
198
views
Prediction intervals for forecasts using spectral analysis
I have circadian data which typically have a period of around 24 hours so using spectral analysis seems appropriate. I've used spectrum resampling which is quite robust to changes in period which ...
3
votes
1
answer
66
views
Testing and validating a limit for experimental data
I have found some similar questions to the one I pose here, but the answers are either over my head, or seem to be slightly off point to what I am trying to accomplish. If it's a true repeat, I ...
3
votes
0
answers
75
views
Regression: Should I use the prediction interval obtained given n=9 and an outlier (Cook's D= 0.558) present?
The data I'm working with has 9 observations. I'm using only one predictor variable. Using SAS, I fit the model and checked the residuals. The typical model assumptions appear to be met, but there ...
3
votes
0
answers
343
views
Prediction interval in principal component regression
I would like to obtain a prediction interval from a model returned by the R package pls. The predict method does not seem to be able to return this value. I wonder ...
3
votes
0
answers
221
views
Prediction errors for Adaboost
I understand how the adaboost algorithm works to produce a prediction of a class, however one thing I haven't seen is how to get a measure of accuracy for that prediction. For example, if I fit a ...
3
votes
0
answers
1k
views
Prediction intervals for a Poisson count (in R)
Is there a convenient way in R to calculate a probability prediction interval
for a count sampled from Poisson($\lambda$), for known lambda? That is, for a given
$\alpha$, find $a$ and $b$ such that $...
3
votes
1
answer
384
views
Estimating probability of an occurrence from historical data
I have 183 percentages based on the accuracy of a price prediction. (If I predict something will sell at 100, and it sells at 100, then I have sold at 100% of the prediction.) 16 times, the ...
3
votes
1
answer
366
views
Tolerance interval vs Prediction interval, which one is wider?
Let say we have a 95% prediction interval, versus 95%/99% tolerance interval, which one is wider?
A. PI always wider than TI
B. TI always wider than PI
C. Depends on sample you get
Thanks!
2
votes
0
answers
60
views
Utilization of standard errors of logistic regression for generating prediction intervals of binomial response
Let us assume that a logistic regression model has been fitted to some training data and that there is new test data in which $n$ predictor combinations are identical, say $\vec{x}$. The probability ...
2
votes
0
answers
87
views
Prediction intervals in the case of changing variance
I derive a point estimate given value $x_0$ using an estimated linear regression as follows:
$$\hat{y_0} = x_0^T\hat{\beta}.$$
I know that a prediction interval for a given value $x_0$: $$\hat{y}_0\pm ...
2
votes
0
answers
64
views
Parametric bootstrap *prediction* interval with heteroskedasticity and sandwich parameter covariance matrix
The sandwich estimator for OLS regressions where heteroskedasticity is suspected is
$$
var(\hat\beta) = (X'X)^{-1}X'ee'X(X'X)^{-1}
$$
If I want confidence intervals on predictions, I can just take ...
2
votes
0
answers
329
views
Prediction Intervals (Conformal Predictions) for Regression Problems
So I've been looking into the idea of looking into conformal predictions, or to obtain prediction intervals instead of just single point predictions. Basically my take is that I would have my deep ...
2
votes
0
answers
55
views
How do I calculate confidence level or interval?
I have this data for exam grades in English Literature:
2019: the numbers achieving (A*, A, B, C, D, E) are (1, 5, 4, 7, 2, 0, 0)
2018: the numbers achieving (A*, A, B, C, D, E) are (2, 4, 3, 7, 0, 1, ...
2
votes
0
answers
200
views
Regarding Hyndman's approach to estimating prediction intervals for forecasts generated by neural networks
I'm currently looking for ways to estimate prediction intervals from an LSTM generated forecast. Several advanced methods are suggested in the literature (e.g. SQF-RNN), but as a first pass, I'm ...
2
votes
0
answers
100
views
Predictive density via LOOCV
I am looking for a way to generate a density prediction (in contrast to a point prediction or a prediction interval) in a multiple regression setting without relying on stringent parametric ...
2
votes
1
answer
1k
views
Confidence intervals for non-parametric statistics
I have a positive random variable $X$ (say, price or latency or energy) and I want to be able to say something like
I am 95% confident that $P(X<42)>0.9$ (percentile) or $P(X<22)\ge\frac12$ (...
2
votes
0
answers
309
views
Are the conditional expectation values of y and f necessarily equivalent in Gaussian processes?
Suppose $y$ is a Gaussian process given by $y \sim f + \epsilon$, where $\epsilon$ is a Gaussian noise model with zero mean, and $f$ is a deterministic yet unknown mean function (or a Gaussian process ...
2
votes
1
answer
251
views
Penalize predictions with larger prediction interval
Suppose I am building a model for regression problems. I am quite curious about the following questions:
Are there relevant theories that can confirm/disprove the following intuition: we should ...
2
votes
0
answers
2k
views
Estimating prediction interval of ARMA process using R forecast function
the theme is forecasting with ARMA models.
I'm trying to understand how the R forecast function works if applied to an ...