Linked Questions
27 questions linked to/from Linear regression prediction interval
5
votes
0
answers
4k
views
Can I calculate prediction intervals in scikit-learn for a linear model without bootstrapping? [duplicate]
I'd like to produce 95% prediction intervals along with predictions from my model. I'm using a moderately large dataset and making thousands of predictions, so I was wondering if there was some way ...
0
votes
0
answers
341
views
Variance of a predicted $y$ when $x_0$ is given? [duplicate]
I cannot figure out why the variance of a prediction of $y$, when given $x_0$ is
$$\sigma^2\bigg(1+\frac 1 n +\frac{(x_0-\bar x)^2}{Sxx}\bigg)$$
Isn't this the variance of a prediction error?
...
0
votes
0
answers
44
views
How to obtain the equation of a predictive interval around the regression line in R? [duplicate]
I have a some data set on which I fit a linear regression model using the lm function in R. I can also visually obtain the prediction Interval around that regression line using predict. My question is ...
68
votes
6
answers
75k
views
What is the difference between estimation and prediction?
For example, I have historical loss data and I am calculating extreme quantiles (Value-at-Risk or Probable Maximum Loss). The results obtained is for estimating the loss or predicting them? Where can ...
44
votes
2
answers
42k
views
Understanding shape and calculation of confidence bands in linear regression
I am trying to understand the origin of the curved shaped of confidence bands associated with an OLS linear regression and how it relates to the confidence intervals of the regression parameters (...
23
votes
3
answers
11k
views
Obtaining a formula for prediction limits in a linear model (i.e.: prediction intervals)
Let's take the following example:
set.seed(342)
x1 <- runif(100)
x2 <- runif(100)
y <- x1+x2 + 2*x1*x2 + rnorm(100)
fit <- lm(y~x1*x2)
This creates a ...
15
votes
2
answers
5k
views
Prediction and Tolerance Intervals
I have a couple of questions for prediction and tolerance intervals.
Let's agree on the definition of the tolerance intervals first: We are given a confidence level, say 90%, the percentage of the ...
16
votes
1
answer
16k
views
Why does the standard error of the intercept increase the further $\bar x$ is from 0?
The standard error of the intercept term ($\hat{\beta}_0$) in $y=\beta_1x+\beta_0+\varepsilon$ is given by $$SE(\hat{\beta}_0)^2 = \sigma^2\left[\frac{1}{n}+\frac{\bar{x}^2}{\sum_{i=1}^n(x_i-\bar{x})^...
9
votes
2
answers
8k
views
Gaussian process prediction interval
How can the prediction interval of a Gaussian process be evaluated? I don't know how to estimate this interval though I can find a 95 % confidence interval for the mean line.
9
votes
2
answers
23k
views
SE of fit versus SE of prediction
I would like to get the standard error on a prediction. Using R glm, I can get the SE of the fit for a specific prediction:
...
6
votes
2
answers
22k
views
Calculation of variance of prediction
Could anybody show me how @Rob Hyndman calculates the variance of $\hat{y}$ in the following link
Obtaining a formula for prediction limits in a linear model :
EDIT: Basically I don't understand how ...
8
votes
5
answers
765
views
Confidence Interval on a random quantity?
Suppose $\vec{a}$ is an unknown $p$-vector, and one observes $\vec{b} \sim \mathcal{N}\left(\vec{a}, I\right)$. I would like to compute confidence intervals on the random quantity $\vec{b}^{\top} \...
0
votes
2
answers
13k
views
What is the best way to extrapolate when working with a linear regression model?
There's not much more to ask than what I've written in the title.
Some of the values I want to predict are outside of the range used to build the regression model.
2
votes
1
answer
9k
views
residual vs. QQ-plot in multiple regression
I'm working on a Kaggle multiple regression tutorial competition and inspecting plots of my residuals. I followed a suggestion and log transformed several independent variables and the dependent ...
13
votes
2
answers
2k
views
Can we make probabilistic statements with prediction intervals?
I've read through the many excellent discussions on the site regarding interpretation of confidence intervals and prediction intervals, but one concept is still a bit puzzling:
Consider the OLS ...