Questions tagged [prediction-interval]

A prediction interval (also forecast interval) is an interval that covers the future (or otherwise unknown, but *observable*) value of a random variable with some prespecified probability.

473 questions
Filter by
Sorted by
Tagged with
15 views

Missing Prediction Intervals by R package autoTS

I'm using autoTS R package to fit automatic time series estimation and prediction to a very very large number of time series. One of the outputs of the prediction function (my.predictions()) is a 95% ...
1 vote
13 views

Risk score uncertainty quantification

I am working on various risk score estimation problems. I assume individual subjects are associated with a true risk $$r_i = f(x_i) + \varepsilon_i$$ where $x_i$ is some available information about ...
• 954
30 views

Bootstrapping with quantiles of data instead of SD*z?

I have recently been bootstrapping the confidence intervals of a neural network model estimated to data. I execute the following psudo-code, which seems similar to previous bootstraps I have done: ...
• 1,263
17 views

Intuition for confidence intervals vs prediction intervals for linear regression

I am having a bit of trouble understanding the difference between a confidence and prediction interval in the context of linear regression, and in what scenario we would use either of them. I've posed ...
6 views

Is there a way to calculate prediction intervals for decision tree or extra trees regression models?

I only see examples of prediction intervals for random forest and linear regressions but do not see much about ensemble models. I'm not sure if my understanding about prediction intervals is correct. ...
1 vote
26 views

Distribution-free prediction intervals in linear regression

I've found some literature on the subject, but it is rather difficult to read. I am wondering if the following simplified method makes sense. My question is what part is correct in this methodology, ...
12 views

How can we call difference between observed values and prediction interval?

As in the topic title. Is it correct to call difference between observed values and prediction intervals a "difference prediction interval"? Or should I go for "O-E prediction interval&...
• 247
1 vote
10 views

Parametric bootstrap *prediction* interval with heteroskedasticity and sandwich parameter covariance matrix

The sandwich estimator for OLS regressions where heteroskedasticity is suspected is $$var(\hat\beta) = (X'X)^{-1}X'ee'X(X'X)^{-1}$$ If I want confidence intervals on predictions, I can just take ...
• 12.1k
132 views

Prediction interval: but instead, the probability that the next datum is above a fixed threshold?

I've been struggling with this problem, and I think I must be missing some important conceptual step. Imagine we observe $\theta_1 \sim N(\mu, \sigma^2)$, with unknown $\mu$ and known $\sigma^2$ (for ...
• 315
34 views

Wide prediction intervals for short time series: how to fix that?

I have very small time series data(24 points) for sales for different-different regions. I need to build Range Forecast (Confidence/Credible Intervals) for sales around it for every region. I tried FB'...
9 views

Confidence interval for the predicted values from normal distribution

Let's say I have some n samples of real values $y_{i}$ and predicted values $\hat{y_{i}}$. The predicted values were calculated from gradient boosting. The things I know from this gradient boosting ...
• 1
1 vote
67 views

Aggregation of Interval Predictions

Given a montly time series, my objective is to provide my client with the next 12 point forecasts along with a yearly forecast. To obtain the yearly forecast, I simply sum up the 12 points forecasts. ...
• 11
21 views

Prediction interval when forecasting a function

I want to forecast a function of x, say with domain the integers from 1 to 100. My data comprises other such functions, observed at times up until now. The functions are given parametrically, so I ...
• 251
28 views

Predicting a in mixed effects logistic regression

I know there are several posts about intervals for lmer models (Prediction interval for lmer() mixed effects model in R) and glmer models (Confidence intervals in probabilities for mixed effects ...
• 105
82 views

Real future value out of 95% predict interval for ARIMA forecast

When the predicted future value actually materializes, does it matter if it is outside the predict interval? The value of prediction intervals is that they express the uncertainty in the forecasts. ...
• 69
26 views

Getting the confidence interval or some sort of range for predictions from optimizations

I am trying to calculate range for my model predictions after performing optimization and getting values of the optimized parameters. I am aware that we can get a standard error of the optimized ...
• 123
12 views

Estimate quantile coverage

I have implemented, say, a (Bayesian) quantile regression model and I want to assess it by comparing the predicted conditional quantile interval between $Q_1$ and $Q_3$ with the true one (in a ...
• 337
1 vote
30 views

Is there a single regression quality metric for the median and the 95% percentile?

I want to evaluate the quality of prediction of two values the median and 95% percentile of a distribution. Is there a standard way to do this? I have thought about using "Mean Mean Average Error&...
• 133
1 vote
36 views

Gaussian Process vs Linear regression: Prediction error

I'm trying to learn GP and every manual says that GP can deliver predictions with uncertainty. Now, as I have learned some linear regression, I don't understand why is that a big deal. The simplest ...
• 115
424 views

Random forests confidence intervals and prediction

This is a short simulation to check the coverage, when used as predictive intervals, of the random forest confidence intervals introduced in the paper: S. Wager, T. Hastie and B. Efron. Confidence ...
• 22k
128 views

Prediction and confidence intervals - large number of predictions

I'm using a regression model to predict one quantity, $y$, given another, $x$. I'm trying to estimate the error in future predictions of $y$, but I'm wondering in which scenarios I can fairly use the ...
• 81
40 views

Is it better to use the prediction interval or the RMSE?

I use a measurement technique $X$ to assess if a good is within production specifications during its manufacturing. $X$ is slow but precise. I wish to find out if I can use a measurement technique $Y$ ...
24 views

Looking for a intuitive explanation behind standard error formulas in linear regression

Suppose, we perform a linear regression for target variable Y with two features X1 and X2 (referred to as X below), I see that various standard errors are calculated as  Mean\ residual\ error = MSE =...
17 views

A question about the exchangeability assumption in conformal predictions

Conformal predictions allow one to add prediction intervals to arbitrary machine learning regression models. For more information see Algorithmic Predictions in a Random World. An assumption of ...
• 2,032
24 views

Confidence intervals for next frame video prediction

I'm using a ConvLSTM network for next frame video prediction. The output is a deterministic prediction of an image in the future. My question is: can a ConvLSTM model give me an interval of prediction ...
• 1
1 vote
50 views

How to Combine ARMA + GARCH For Estimates + CI in Python

I know I'm trekking down a well beaten path with this type of question, but I find myself trying to clarify how to combine several snippets on the internet and coming up empty handed. There is one ...
28 views

Forecast with inputs that are previous forecasts

I have an hourly time series and I have built a linear regression model that has different inputs: Previous value of the time series. Value in the last period of the time series, it is a weekly ...
1 vote
77 views

Should boostrapped prediction intervals be normally distributed?

I am trying to implement boostrap prediction interval example of FPP3 book in python for learning purposes (https://otexts.com/fpp3/prediction-intervals.html). Prediction interval is estimated by ...
• 59
61 views

How to compute a prediction interval on rescaled power transformed data?

Given a training dataset $\mathcal{D} = \{ (x_i, y_i) \in \mathbb{R}_+^2 | 1 \leq i \leq n\}$ one can fit a linear regression $y_i = a \cdot x_i + b + \varepsilon_i = \hat{y}_i + \varepsilon_i$. That ...
1 vote
20 views

Prediction Intervals and Tolerance Intervals [duplicate]

I have a question regarding interpretation of prediction intervals and confidence intervals. The definitions I've seen is: (1) A prediction interval for a single future observation is an interval ...
• 129
16 views

Translating polyval from matlab to python

I need to translate a script from matlab to python. I run into an issue with the polyfit/polyval functions. Matlab polyval returns a "delta" value which is a standard error dependend on the ...
• 1
40 views

Upper Bound for Size of Prediction Interval

I was thinking of this problem, and I'm not sure if I'm right with this approach. X is a R.V. with unknown distribution, bounded to the interval [a,b], with a < b and both finite. If I take a very ...
• 13
37 views

Uncertainity band in Neural networks

I am working on a problem where I have to give the uncertainty band of my predictions like the image attached. I have seen a StackExchange solution for this, but in the solution code, we are using ...
48 views

How can I find the prediction interval for a no-intercept simple linear regression model?

I have a dataset in which the $x$ and $y$ values represent metrics roughly equivalent to monthly sales opportunities vs. completed deals. These appear to be linearly correlated. I'm performing a no-...
1 vote
59 views

Obtaining individual level classifications from predicted probabilities

I need to produce predictions for a binary state at the individual level. The response variable is imbalanced, about 99:1, with the positive class being the minority. Each row in my dataset represents ...
• 1,019
11 views

Using historical proportions for prediction intervals estimated at a more aggregated level?

Currently, I am working on quite a general problem where I need to forecast some business-related value like target events (clicks, acquisitions, etc). Given the number of different breakdowns (by ...
• 106
10 views

Agricultural product decision making under price volatility

I am recently doing agricultural price forecasting to make decision in which month the company should buy them (normally when the price is low). But, the company decided to not buy all of stock they ...
247 views

Logistic regression: how to compute a prediction interval

Suppose I have a simple logistic regression model: $log(p/(1-p)) = \beta_0 + \beta_1x$ Then I know: $p/(1-p) = e^{\beta_0 + \beta_1x}$ and $p = e^{\beta_0 + \beta_1x}/(1 + e^{\beta_0 + \beta_1x})$ How ...
1 vote
56 views

Estimating Prediction Intervals for Class Probabilities in Random Forests

I have found multiple questions here (e.g. this) and great academic papers (e.g. this and this) about calculating prediction intervals for Random Forest and other techniques applied to regression ...
• 121
1 vote
85 views

Analytical Leave-one-out prediction variance for Kriging

I make extensive use of Kriging (Gaussian Process regression) methods in my work especially using the leave-one-out error calculation that you can get from the Gram matrix. Background: To compute the ...
38 views

Prediction Intervals the Same in Multi-Step with R Forecast Package - Why?

Using the R forecast package for a multi-step time series forecasting exercise, I've noticed that sometimes I get the same prediction interval at each step (6 months, in my case) and sometimes, I get ...
• 25
43 views

Point Estimates using forecast in R for Multi-Step TS Forecast -- Sometimes Same/Sometimes Not -- Why?

I am using the simple forecast(data, h = 6) function in R - as I work through Hyndman's 'Forecasting: Principles and Practice" textbook - which returns forecasts from the ETS algorithm. I'm not ...
• 25
1 vote
120 views

• 3,768
1 vote