Linked Questions

5 votes
0 answers
4k views

Can I calculate prediction intervals in scikit-learn for a linear model without bootstrapping? [duplicate]

I'd like to produce 95% prediction intervals along with predictions from my model. I'm using a moderately large dataset and making thousands of predictions, so I was wondering if there was some way ...
James Kelleher's user avatar
0 votes
0 answers
341 views

Variance of a predicted $y$ when $x_0$ is given? [duplicate]

I cannot figure out why the variance of a prediction of $y$, when given $x_0$ is $$\sigma^2\bigg(1+\frac 1 n +\frac{(x_0-\bar x)^2}{Sxx}\bigg)$$ Isn't this the variance of a prediction error? ...
proaksciasd's user avatar
0 votes
0 answers
44 views

How to obtain the equation of a predictive interval around the regression line in R? [duplicate]

I have a some data set on which I fit a linear regression model using the lm function in R. I can also visually obtain the prediction Interval around that regression line using predict. My question is ...
user3841581's user avatar
68 votes
6 answers
75k views

What is the difference between estimation and prediction?

For example, I have historical loss data and I am calculating extreme quantiles (Value-at-Risk or Probable Maximum Loss). The results obtained is for estimating the loss or predicting them? Where can ...
melon's user avatar
  • 681
44 votes
2 answers
42k views

Understanding shape and calculation of confidence bands in linear regression

I am trying to understand the origin of the curved shaped of confidence bands associated with an OLS linear regression and how it relates to the confidence intervals of the regression parameters (...
David's user avatar
  • 441
23 votes
3 answers
11k views

Obtaining a formula for prediction limits in a linear model (i.e.: prediction intervals)

Let's take the following example: set.seed(342) x1 <- runif(100) x2 <- runif(100) y <- x1+x2 + 2*x1*x2 + rnorm(100) fit <- lm(y~x1*x2) This creates a ...
Tal Galili's user avatar
  • 21.6k
15 votes
2 answers
5k views

Prediction and Tolerance Intervals

I have a couple of questions for prediction and tolerance intervals. Let's agree on the definition of the tolerance intervals first: We are given a confidence level, say 90%, the percentage of the ...
Ioannis Souldatos's user avatar
16 votes
1 answer
16k views

Why does the standard error of the intercept increase the further $\bar x$ is from 0?

The standard error of the intercept term ($\hat{\beta}_0$) in $y=\beta_1x+\beta_0+\varepsilon$ is given by $$SE(\hat{\beta}_0)^2 = \sigma^2\left[\frac{1}{n}+\frac{\bar{x}^2}{\sum_{i=1}^n(x_i-\bar{x})^...
elexhobby's user avatar
  • 845
9 votes
2 answers
8k views

Gaussian process prediction interval

How can the prediction interval of a Gaussian process be evaluated? I don't know how to estimate this interval though I can find a 95 % confidence interval for the mean line.
Wis's user avatar
  • 2,164
9 votes
2 answers
23k views

SE of fit versus SE of prediction

I would like to get the standard error on a prediction. Using R glm, I can get the SE of the fit for a specific prediction: ...
John's user avatar
  • 435
6 votes
2 answers
22k views

Calculation of variance of prediction

Could anybody show me how @Rob Hyndman calculates the variance of $\hat{y}$ in the following link Obtaining a formula for prediction limits in a linear model : EDIT: Basically I don't understand how ...
HeyJane's user avatar
  • 355
8 votes
5 answers
765 views

Confidence Interval on a random quantity?

Suppose $\vec{a}$ is an unknown $p$-vector, and one observes $\vec{b} \sim \mathcal{N}\left(\vec{a}, I\right)$. I would like to compute confidence intervals on the random quantity $\vec{b}^{\top} \...
shabbychef's user avatar
  • 14.8k
0 votes
2 answers
13k views

What is the best way to extrapolate when working with a linear regression model?

There's not much more to ask than what I've written in the title. Some of the values I want to predict are outside of the range used to build the regression model.
madsthaks's user avatar
  • 297
2 votes
1 answer
9k views

residual vs. QQ-plot in multiple regression

I'm working on a Kaggle multiple regression tutorial competition and inspecting plots of my residuals. I followed a suggestion and log transformed several independent variables and the dependent ...
Austin's user avatar
  • 753
13 votes
2 answers
2k views

Can we make probabilistic statements with prediction intervals?

I've read through the many excellent discussions on the site regarding interpretation of confidence intervals and prediction intervals, but one concept is still a bit puzzling: Consider the OLS ...
kevinykuo's user avatar
  • 641

15 30 50 per page