Questions tagged [standard-error]

Refers to the standard deviation of the sampling distribution of a statistic calculated from a sample. Standard errors are often required when forming confidence intervals or testing hypotheses about the population from which the statistic was sampled.

Filter by
Sorted by
Tagged with
145
votes
15answers
118k views

Intuitive explanation for dividing by $n-1$ when calculating standard deviation?

I was asked today in class why you divide the sum of square error by $n-1$ instead of with $n$, when calculating the standard deviation. I said I am not going to answer it in class (since I didn't ...
123
votes
3answers
142k views

How are the standard errors of coefficients calculated in a regression?

For my own understanding, I am interested in manually replicating the calculation of the standard errors of estimated coefficients as, for example, come with the output of the ...
99
votes
4answers
100k views

Difference between standard error and standard deviation

I'm struggling to understand the difference between the standard error and the standard deviation. How are they different and why do you need to measure the standard error?
21
votes
3answers
23k views

How can I calculate margin of error in a NPS (Net Promoter Score) result?

I'll let Wikipedia explain how NPS is calculated: The Net Promoter Score is obtained by asking customers a single question on a 0 to 10 rating scale, where 10 is "extremely likely" and 0 is "...
70
votes
2answers
27k views

Shape of confidence interval for predicted values in linear regression

I have noticed that the confidence interval for predicted values in an linear regression tends to be narrow around the mean of the predictor and fat around the minimum and maximum values of the ...
17
votes
3answers
3k views

How does the standard error work?

I have been looking into the inner-workings of the standard error recently, and I found myself unable to understand how it works. My understanding of the standard error is that it is the standard ...
4
votes
2answers
2k views

Why is there a need for a 'sampling distribution' to find confidence intervals?

I understand the key principles behind confidence intervals, but there's something I want a bit of clarification on. Let's say I have a basket of apples that I picked at the orchard. The weight is ...
62
votes
6answers
10k views

Standard errors for lasso prediction using R

I'm trying to use a LASSO model for prediction, and I need to estimate standard errors. Surely someone has already written a package to do this. But as far as I can see, none of the packages on CRAN ...
20
votes
1answer
11k views

What is the standard error of the sample standard deviation?

I read from there that the standard error of the sample variance is $$SE_{s^2} = \sqrt{\frac{2 \sigma^4}{N-1}}$$ What is the standard error of the sample standard deviation? I'd be tempted to guess ...
8
votes
2answers
4k views

Confidence intervals for median

I have a distribution of samples with a small number of values in each one (less than $10$). I have calculated the median for each sample, which I want to compare with a model and obtain the ...
23
votes
2answers
94k views

How to derive the standard error of linear regression coefficient

For this univariate linear regression model $$y_i = \beta_0 + \beta_1x_i+\epsilon_i$$ given data set $D=\{(x_1,y_1),...,(x_n,y_n)\}$, the coefficient estimates are $$\hat\beta_1=\frac{\sum_ix_iy_i-n\...
8
votes
1answer
11k views

Why autocorrelation affects OLS coefficient standard errors?

It seems that OLS residuals autocorrelation is not always an issue, depending on the problem at hand. But why residuals autocorrelation would affect the coefficient standard errors? From the Wikipedia ...
13
votes
3answers
8k views

Adding coefficients to obtain interaction effects - what to do with SEs?

I have a multivariate regression, which includes interactions. For example, to get the estimate of the treatment effect for the poorest quintile I need to add the coefficients from the treatment ...
9
votes
2answers
3k views

Meaning of 2.04 standard errors? Significantly different means when confidence intervals widely overlap?

The image below is from this article in Psychological Science. A colleague pointed out two unusual things about it: According to the caption, the error bars show "±2.04 standard errors, the 95% ...
14
votes
3answers
1k views

Why does this excerpt say that unbiased estimation of standard deviation usually isn't relevant?

I was reading on the computation of the unbiased estimation of standard deviation and the source I read stated (...) except in some important situations, the task has little relevance to ...
13
votes
1answer
12k views

Why does the standard error of the intercept increase the further $\bar x$ is from 0?

The standard error of the intercept term ($\hat{\beta}_0$) in $y=\beta_1x+\beta_0+\varepsilon$ is given by $$SE(\hat{\beta}_0)^2 = \sigma^2\left[\frac{1}{n}+\frac{\bar{x}^2}{\sum_{i=1}^n(x_i-\bar{x})^...
7
votes
2answers
1k views

Standard error of regression coefficient without raw data

After searching here: Perform simple regression without raw data I am still curious about this. Is it possible to derive the standard error of a regression coefficient from summary data alone? E....
33
votes
4answers
39k views

Standard error clustering in R (either manually or in plm)

I am trying to understand standard error "clustering" and how to execute in R (it is trivial in Stata). In R I have been unsuccessful using either plm or writing my ...
14
votes
3answers
22k views

Standard error of the median

Is the following formula right if I want to measure the standard error of the median in case of a small sample with non normal distribution (I'm using python)? ...
18
votes
3answers
10k views

How can I estimate coefficient standard errors when using ridge regression?

I am using ridge regression on highly multicollinear data. Using OLS I get large standard errors on the coefficients due to the multicollinearity. I know ridge regression is a way to deal with this ...
10
votes
2answers
21k views

General method for deriving the standard error

I can't seem to find a general method for deriving standard errors anywhere. I've looked on google, this website and even in text books but all I can find is the formula for standard errors for the ...
26
votes
1answer
73k views

Converting standard error to standard deviation?

Is it sensible to convert standard error to standard deviation? And if so, is this formula appropriate? $$SE = \frac{SD}{\sqrt{N}}$$
13
votes
1answer
9k views

Converting standardized betas back to original variables

I realise this is probably a very simple question but after searching I can't find the answer I am looking for. I have a problem where I need to standardize the variables run the (ridge regression) ...
14
votes
4answers
5k views

Follow up: In a mixed within-between ANOVA plot estimated SEs or actual SEs?

I am currently finishing a paper and stumbled upon this question from yesterday which led me to pose the same question to myself. Is it better to provide my graph with the actual standard error from ...
8
votes
2answers
4k views

How to deal with quasi-complete separation in a logistic GLMM?

Update: Since I now know that my problem is called quasi-complete separation I updated the question to reflect this (thanks to Aaron). I have a dataset from an experiment in which 29 human ...
4
votes
3answers
12k views

Standard error of a ratio

I have a linear regression and two estimates, say A and B and their standard errors. I need to find the standard error of a ratio A/B [or A/(1-B)]. I guess the main problem is that I don't know the ...
12
votes
2answers
4k views

Finding precision of Monte Carlo simulation estimate

Background I am designing a Monte Carlo simulation that combines the outputs of series of models, and I want to be sure that the simulation will allow me to make reasonable claims about the ...
6
votes
1answer
4k views

Hausman test: the larger the sample the more significant the Hausman test statistic?

Hausman test statistic formula: $$ H=(\beta_{f}-\beta_{r})' \left[\mathrm{Cov}(\beta_{f})-\mathrm{Cov}(\beta_{r})\right]^{-1}(\beta_{f}-\beta_{r} ) $$ where $\beta_{f}$ is the beta of fixed effects ...
45
votes
4answers
79k views

Standard error for the mean of a sample of binomial random variables

Suppose I'm running an experiment that can have 2 outcomes, and I'm assuming that the underlying "true" distribution of the 2 outcomes is a binomial distribution with parameters $n$ and $p$: ${\rm ...
19
votes
5answers
7k views

How to display error bars for cross-over (paired) experiments

The following scenario has become the Most-FAQ in the trio of investigator (I), reviewer/editor (R, not related to CRAN) and me (M) as plot creator. We can assume that (R) is the typical medical big ...
18
votes
1answer
49k views

Standard errors for multiple regression coefficients?

I realize that this is a very basic question, but I can't find an answer anywhere. I'm computing regression coefficients using either the normal equations or QR decomposition. How can I compute ...
15
votes
2answers
14k views

Calculating confidence intervals for a logistic regression

I'm using a binomial logistic regression to identify if exposure to has_x or has_y impacts the likelihood that a user will click ...
20
votes
6answers
47k views

Always Report Robust (White) Standard Errors?

It has been suggested by Angrist and Pischke that Robust (i.e. robust to heteroskedasticity or unequal variances) Standard Errors are reported as a matter of course rather than testing for it. Two ...
9
votes
2answers
8k views

How do you calculate standard errors for a transformation of the MLE?

I need to make inference about a positive parameter $p$. To acomodate the positiveness I reparametrized $p=\exp(q)$. Using MLE routine I computed point estimate and s.e for $q$. The invariance ...
8
votes
2answers
2k views

Confidence interval for the median

I have a set of values ${x_i}, i=1, \dots ,N$ of which I calculate the median M. I was wondering how I could calculate the error on this estimation. On the net I found that it can be calculated as $1....
6
votes
2answers
35k views

Standard deviation of a ratio (percentage change)

I have 2 data sets. The first data set, let's call it $X$ has an average value of ($\bar X$) and standard deviation of ($STD_X$), the second set of data also has the average value of ($\bar Y$) and ...
7
votes
1answer
1k views

Why does standard error not involve population size?

$$SE = \frac{SD}{\sqrt{N}}$$ If N is the entire population, I would expect SE to be zero. If N is equal to population size - 1, I would expect SE to be lower than if N is a small fraction of the ...
7
votes
2answers
18k views

Standard errors of a two stage least squares regression, Stata

I use Stata. I am trying to replicate the ivreg output of a regression performing manually the first stage, predicting the instrument after the first stage and running the second stage regression with ...
5
votes
2answers
1k views

Not sure if standard error of p-values makes sense in Fisher Exact Test

I am working on implementing a Fisher Exact Test for some unemployment and wage data. The idea is to describe two populations (one receiving an assistance program (the "treatment") and one not ...
8
votes
1answer
5k views

Is the residual, e, an estimator of the error, $\epsilon$?

This question has come up in another thread that I started so I thought I would get more people's opinions on it. My question is Is the residual, e, an estimator of the error, $\epsilon$? The reason ...
5
votes
2answers
2k views

Robust standard errors in econometrics

I keep hearing my professor try to explain that we can use robust standard errors when we run a regression to confront the issue of heteroskedasticity. However I don't quite understand how telling ...
30
votes
3answers
5k views

Why not report the mean of a bootstrap distribution?

When one bootstraps a parameter to get the standard error we get a distribution of the parameter. Why don't we use the mean of that distribution as a result or estimate for the parameter we are trying ...
7
votes
1answer
9k views

How to calculate the standard error of the marginal effects in interactions (robust regression)?

what I am interested in learning is how to calculate the std error of the marginal effects of a X variable when it is part of an interaction, especially in robust regression. There are tipically two ...
3
votes
1answer
6k views

Proof that regression residual error is an unbiased estimate of error variance

Consider the least squares problem $Y=X\beta +\epsilon$ while $\epsilon$ is zero mean Gaussian with $E(\epsilon) = 0$ and variance $\sigma^2$. I need to prove that $\frac{V(\hat{\beta})}{N-(n+m)}$ ...
14
votes
4answers
27k views

Why do we say “Residual standard error”?

A standard error is the estimated standard deviation $\hat \sigma(\hat\theta)$ of an estimator $\hat\theta$ for a parameter $\theta$. Why is the estimated standard deviation of the residuals called "...
7
votes
2answers
2k views

Standard error of the sampling distribution of the mean

I found an equation that says the standard error of the sampling distribution of the mean is: $$\sigma_{\bar{X}} = \sigma \cdot \sqrt{\frac{1}{n}-\frac{1}{N}}$$ And when the population size is very ...
3
votes
1answer
6k views

Standard error from OR and HR

I'm planning to combine several observational studies, some of which have produced odds ratios and some hazard ratios. How do I get the standard error from the odds ratio $1.57$ ($95\%$ CI: $1.08-2.27$...
3
votes
1answer
18k views

Understanding standard errors in logistic regression

I am having trouble understanding the meaning of the standard errors in my thesis analysis and whether they indicate that my data (and the estimates) are not good enough. I am performing an analysis ...
1
vote
2answers
336 views

Using variance from a Jeffreys prior in a Prevalence meta-analysis

I am doing a meta-analysis on a group of studies, where the observation is a rate (no. of successes / no of trials). Some of the studies have small sample sizes (n<10) and/or did not observe any ...
8
votes
2answers
440 views

What's the accuracy of data obtained through a random sample?

I'm a newbie at stats, so if I make any mistaken assumptions here please tell me. There's a population N of people. (For example ...