Linked Questions

110 votes
10 answers
26k views

What is meant by a "random variable"?

What do they mean when they say "random variable"?
Baltimark's user avatar
  • 2,288
198 votes
3 answers
247k views

What is the difference between a consistent estimator and an unbiased estimator?

What is the difference between a consistent estimator and an unbiased estimator? The precise technical definitions of these terms are fairly complicated, and it's difficult to get an intuitive feel ...
MathematicalOrchid's user avatar
62 votes
7 answers
28k views

Intuitive explanation of the bias-variance tradeoff?

I am looking for an intuitive explanation of the bias-variance tradeoff, both in general and specifically in the context of linear regression.
NPE's user avatar
  • 5,591
58 votes
5 answers
21k views

When is a biased estimator preferable to unbiased one?

It's obvious many times why one prefers an unbiased estimator. But, are there any circumstances under which we might actually prefer a biased estimator over an unbiased one?
Stan Shunpike's user avatar
25 votes
5 answers
51k views

What is the relation between estimator and estimate?

What is the relation between estimator and estimate?
user avatar
3 votes
1 answer
18k views

What is the difference between Mean Squared Deviation and Variance?

I am doing some tutoring for an AS-Level maths student and unfortunately for me they are doing statistics. This is not my strong point, mainly from the point of view of remembering all of the ...
josh's user avatar
  • 3,279
2 votes
2 answers
2k views

When are OLS linear regression parameters inaccurate?

Q1: Show quantitatively that OLS regression can be applied inconsistently for linear parameters estimation. OLS in y returns a minimum error regression line for estimating y-values given a fixed x-...
Carl's user avatar
  • 13.2k
2 votes
1 answer
753 views

Binary classification and target-label proportion

Suppose that we have a binary classification problem with a vector y = [1 1 0 1 0 0 1 ... 0] having the proportion: ...
ℂybernetician's user avatar
2 votes
1 answer
346 views

Empirical Implications of Unbiased Estimators

I am familiar with the layperson explanation of an unbiased estimator as follows: if we repeat an experiment under identical conditions many times, the average value of the estimate will be close to ...
Mr Saltine's user avatar
0 votes
2 answers
416 views

What is difference between statistical bias and common sense bias [closed]

Colloquially, a statistic may be described as “biased” if it misrepresents whatever it’s intended to represent, whether or not it was more likely a priori to err in one direction or another. (This ...
CoolKid's user avatar
  • 213
1 vote
1 answer
50 views

Unbiasedness property under trimmed data

Suppose we want to estimate a simple regression model by OLS and the selected model is the true model. Randomly trimming data does not change the unbiasedness property of the coefficient. However, ...
ykkoca's user avatar
  • 13