# Tagged Questions

22 views

### Why does one bootstrap sample help reduce bias in a biased variance estimator?

I am looking a bit on the effect of bootstrap on bias. I came by the following example in the estimation of variance (when dividing by n instead of n-1). Can someone explain to me why the bias when ...
29 views

### Bias-variance tradeoff — bias or variance effect

I understand that supervised learning is associated with an error that can be split between bias and variance: $MSE = b^2 + var$ What does bias and variance account for intuitively ? I ...
36 views

### RMSE when parameter is observed with uncertainty

Here is my situation: I want to know the value of some parameter $\theta$ and I have a bunch of different estimates of it. Because each estimate is drawn from a different sample, I observe the ...
277 views

### (Why) do overfitted models tend to have large coefficients?

I imagine that the larger a coefficient on a variable is, the more ability the model has to "swing" in that dimension, providing an increased opportunity to fit noise. Although I think I've got a ...
168 views

### Model variance and bias in cross validation

This question is partly inspired about the answer to this other question: Number of folds for K-fold. The fundamental question I have is the following: How do different cross-validation methods ...
60 views

### What's the difference between bias in model error in regression?

Is model error the same as bias in regression? For example, if I construct data by $y_i=N^{\text{th}}$ degree polynomial plus uncorrelated noise, and do a regression with the $M^{\text{th}}$ degree ...
117 views

### Confusion related to the bagging technique

I am having a bit of confusion. I was reading this paper where it explained that bagging technique greatly reduces variance and only slightly increases bias. I didn't get it how come it reduces ...
184 views