Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [mse]

MSE stands for Mean Squared Error. It is a measure of the performance of an estimate or prediction, equal to the mean squared difference between the observed values and the estimated / predicted values.

0
votes
0answers
13 views

why is VAE reconstruction loss equal to MSE loss

At which situations does reconstruction loss of VAE equals MSE loss between input and reconstructed output? Other answers where not complete!
1
vote
0answers
26 views

Do unbiased regression coefficents yield better prediction?

I ask myself if a have a omitted variables bias in my regression modell the coefficients of the model are biased so the mse growth because this coefficents are biased right? So does it mean if i ...
1
vote
1answer
35 views

K-means calculate MSE in Weka

I am doing some clustering analysis with Weka and decided to apply the k-means algorithm (the clusterer SimpleKMeans). On my first analysis I ran the algorithm with 2 clusters. Then, after finding ...
0
votes
1answer
20 views

Correct way to calculate MSE for autoencoders with batch-training

Suppose you have a network representing an autoencoder (AE). Let's assume it has 90 inputs/outputs. I want to batch-train it with batches of size 100. I will denote my input with ...
2
votes
1answer
14 views

Precision vs. Accuracy when talking about MSE

This is more of a semantic question. I'm working on translating a work from French to English related to statistics. In French, there is only 1 word as far as I can tell to describe both bias and ...
1
vote
1answer
16 views

I ran an ANN model and got an extremely low R2 but a pretty good MSE, what does this mean? [closed]

I ran an artificial neuron network on data with about 2,000 rows and 3 features. I got a R2 of .06 which is really low, but a good MSE of .41. Why are these performance evaluators of this model ...
0
votes
0answers
7 views

Why different seeds produce different mse values for regression tree and ols?

I compare regression tree and ols in terms of out of sample prediction. I realized that the mse values changed when i change the seeds before getting train and test set. Sometimes ols is better ...
0
votes
1answer
27 views

When does OLS Regression outperform regression tree in term of out of sample prediction?

In my Master thesis i compare ols regression to regression tree to predict wages. I thought that i will get better prediction with the regression tree because it cathes more interactions. But now i ...
0
votes
0answers
19 views

Use MSE in cv.glmnet for Poisson models?

I want to compare different methods (like Poisson regression using Lasso, a convolutional NN, etc.) in terms of prediction error. As error measures I chose the MSE, the MdAPE (median absolute ...
1
vote
0answers
38 views

R-squared vs MSE, why the discrepancy?

I am carrying out a project where I am imputing missing data. I am trying to compare an imputed dataset with a baseline dataset by measuring MSE and R-squared. These metrics are measured by ...
2
votes
0answers
22 views

Mean Squared Error as quantifier of the Bias-Variance tradeoff

I have acquired the impression that many of the people doing statistical work, will prefer a biased estimator $\hat b$ to an unbiased one $\hat \beta$, if the former has lower Mean Squared Error. This ...
0
votes
1answer
49 views

Calculate the constants and the MSE from two estimators related to a uniform distribution

Consider a simple random sample $X_{1},X_{2},\ldots,X_{n}$ whose distribution is given by $X\sim U(0,\theta)$. Moreover, consider the estimators $\hat{\theta}_{1} = c_{1}\overline{X}$ and $\hat{\theta}...
0
votes
1answer
22 views

How to determine mse of estimate from correlation matrix of estimate error?

I have a model of an information transmission system Y = XH + N, where X is a diagonal matrix with the transmitted "symbols" (known), H is a column vector which distorts the transmitted symbols and N ...
0
votes
0answers
34 views

Derivation of AMISE and Bandwidth

Given: Let $K(\cdot)$ be a bona fide kernel. Let $f$ be a pdf and $\widehat{f}_n$ is kernel density estimator with bandwidth $h$ based on a sample $X_1,X_2,\cdots,X_n$ of size $n$ draw iid from $f$. ...
0
votes
0answers
88 views

calculating mse for knn regression object

I'm fairly new to knn, R implementation and am trying to figure out how to calculate the MSE for a model that uses knn based on linear regression with 3 nearest neighbors and get the error shown above....
0
votes
0answers
102 views

Calculating mean square error for a knn regression object

I'm fairly new to knn, R implementation and am trying to figure out how to calculate the MSE for a model that uses knn based on linear regression with 3 nearest neighbors and get the error shown above....
1
vote
0answers
17 views

Log or MSE loss for hyperparameter tuning of probabilistic NN

I am building a predictive model of a dynamical system using a NN whose output neurons enconde the mean and diagonal covariance of a Gaussian distribution. For training, the negative log prediction ...
0
votes
0answers
32 views

Represent Mean-Squared-Prediction error as function of covariance (or Fisher) matrix

Given a simple linear model: $$ y_i = x_i^T \beta + \epsilon_i $$ For simplicity, $\epsilon_i$ is Gaussian iid with variance $\sigma_e^2$, then the solution for $\hat{\beta}$ is given via Ordinary ...
2
votes
1answer
70 views

variance of nonparametric estimator of mean

I'm having some trouble with understanding how to calculate the variance of a non-parametric estimator. The example comes from Wasserman's "All of statistics book" Let $X_1, \ldots,X_n \sim \text{...
0
votes
1answer
36 views

Maximum likelyhood of distribution

$L$ is the upper limit of the sample distribution $[0, L]$ which is uniform and normal. how can I show that $L=\frac{(n+1)*max(X_i)}{n}$ is unbiased. and also has a lower MSE than MLE?
1
vote
1answer
44 views

Distribution function of a biased estimator

$f(y) = ay^{a-1}/θ^a, 0<y<θ$ $ \hat{\Theta} = max(Y_1, Y_2, . . . , Y_n).$ How do I find the $E[\hat{\Theta}]$ ? I'm trying to show that it's a biased estimator, then I'm going to find ...
4
votes
1answer
61 views

What is the best point forecast for gamma distributed data?

I believe that the values I am forecasting are gamma distributed with shape $k>0$ and scale $\theta>0$. I need a point forecast (i.e., a one-number summary) that minimizes the expected error. ...
3
votes
1answer
49 views

What is the best point forecast for lognormally distributed data?

I believe that the values I am forecasting are lognormally distributed with log-mean $\mu$ and log-variance $\sigma^2$. I need a point forecast (i.e., a one-number summary) that minimizes the expected ...
0
votes
0answers
128 views

How can RMSE be compared between a regression model and a neural network model?

In the calculation of RMSE, linear regression uses degrees of freedom(n-p) as divisor and neural network(feed-forward in my case) uses the total data number(does it have degrees of freedom as well?). ...
4
votes
2answers
74 views

Steps of Matrix Multiplication

It may seem kind of silly, but can anyone please show me the intermediate steps implied by the second equality in this derivation? $$e^\prime e = \left(y - Xb\right)^\prime\left(y - Xb\right) = y^\...
0
votes
0answers
42 views

Bayesian Inference and MSE. Need help to understand solution

I have problems with understanding solution of Problem 4.c (MSE) here. I couldn't get exact number. My solution is following (numbers for $X_M$ in table above): I start with calculating $E(X-X_M)^2 ...
0
votes
0answers
10 views

On dichotomizing a continuous variable and how it affects MSE of OLS

Recently I have learned about the practice of dichotomizing a continuous independent variable (or maybe even discretize it into more than 2 categories), and then run a predictive model (e.g. multiple ...
0
votes
1answer
127 views

How to evaluate neural network regression model

I have some data with 2963 observations and 7 variables. I want to use regression and train this data using neural network then evaluate the regression model. I've tried splitting the data into ...
0
votes
2answers
154 views

When MSE for CV is greater than test MSE?

In an introduction to statistical learning book, on page 311 there is a figure which compares MSE vs the number of leaves. I like to know the reason that Cross-Validation's Mean Square Error curve is ...
0
votes
1answer
41 views

Is there an advantage to normalizing labels when using MSE loss?

I am designing a NN that uses MSE as a loss regressor. Its a big network and when I train, the loss/gradients are HUGE. I have to clip my gradients our else the loss just goes to NaNs. The differences ...
0
votes
1answer
48 views

How is Test MSE being calculated here?

I'm reading Andrew Ng's CS229 course notes on machine learning, and I'm at the part about Bias-Variance Tradeoff. Here, we're modeling our data as $y_i = f(x_i) + \epsilon_i$ where $\epsilon_i$ are i....
0
votes
0answers
43 views

Reporting mean-squared error using test set

I'm reading an article in which the mean-squared error of the model $$y=X\beta + \varepsilon,~~E(\varepsilon)=0\text{ and }Var(\varepsilon) = \sigma^2$$ is defined as $$ME = E[X\hat{\beta} - X\beta]^...
0
votes
1answer
31 views

multiple linear regression error minimization

regression analysis in different statistical packages fits the best line by minimizing the error of the fit, the error term used by default is mostly MSE (mean square error), in other words, ...
1
vote
1answer
144 views

Bias-variance decomposition of MSE

I'm trying to decompose the MSE into the bias and variance terms and have done the following: $$MSE = \frac{1}{n}\sum_{i=1}^{n}(y_i - \hat{y_i})^2$$ $$E(MSE) = E\left[\frac{1}{n}\sum_{i=1}^{n} (y_i - ...
0
votes
0answers
25 views

Defining “variance” of a partially defined random variable

Elsewhere within CrossValidated the following survey sampling problem was mention. To each member $i$ of a population $\{1,\ldots,N\}$ there is assigned some value $c_i$ whose average $\mu=(c_1+\cdots+...
0
votes
0answers
40 views

How to interpret log-likelihood score as compared to mse

Say one has a linear dynamic system as follows: $x_k = Fx_{k-1} + v_k$ $y_k = Hx_{k-1} + w_k$ with $v \sim (0, Q)$ and $w \sim (0, R)$. I am estimating $(x)_k$ using a normal Kalman Filter and ...
4
votes
2answers
283 views

question about MSE mean square error

The following is taken literally from Wikipedia's mean squared error in the mean subheading: "Suppose we have a random sample of size $n$ from a population, $X_1$, ... ,$X_n$. Suppose the sample ...
0
votes
1answer
134 views

Feed-forward neural network (MSE and Cross-entropy) questions

Question 1 Why do we divide by the number of data points (N)? I think it's done to minimize the error being back-propagated, but can't we just don't do that and instead decrease the learning rate to ...
0
votes
1answer
36 views

A different MSE criterion

I need to use the criterion $$\text{MSE}=(\hat\beta-\beta)^T\,V\,(\hat\beta-\beta)$$ for a linear regression model to estimate the test MSE. Here $\beta$'s are ...
1
vote
0answers
193 views

How to find the root mean square error in `auto.arima` in R? [closed]

How do I find the root mean square error (RMSE) by auto.arima? What settings do I need to put into auto.arima to get the RMSE?
1
vote
0answers
41 views

regression model can't achieve low bias and low variance at the same time

I am running a RandomForestRegressor model on a dataset and it seems it can NOT achieve low bias and low variance at the same time. So I suspected that the input (independent) variables are not ...
1
vote
0answers
109 views

weighted mean square error

Here is something from my text: "A model's fit to new data can be summarized numerically by mean square error , $\frac{1}{n}\sum^n_{i=1}[y_i-E(y_i|\theta)]^2$, or weighted version such as $\frac{1}{n}...
1
vote
0answers
58 views

Model Selection using MSE

In these lecture notes, we talk about choosing among two models: $Y = \beta_0 + \beta_1X1 + \beta_2X_2 + \epsilon$ or $Y = \beta_0 + \beta_1X1 + \beta_2X_2 + \beta_3X_1X_2 + \beta_4X_1^2 + \...
0
votes
1answer
591 views

MSE and different types of activation functions in NN

Lets say I have 3 neurons in the last layer of my neural network and I am using mean squared error as a loss function. The desired output of my neural network is a vector: ...
1
vote
0answers
153 views

cv.glmnet, minimal MSEis higher than OLS MSE

I have a data with multicollinearity. I can't exclude the correlated variable as they are my variable of interest. I therefore Used Ridge regression, and tried to find optimal lambda with CV. I face ...
-1
votes
1answer
191 views

Train MSE becomes smaller then test mse when model becomes morgen complex

Iam doing a ridge and lasso regression and choose my lambdas via cross validation with K = 5 and K = 10. I do this with 3 data sets because i want to analize if more variables yield to a better ...
1
vote
0answers
92 views

How to estimate the standard error of the leave-one-out cross-validation estimate of the prediction error?

How does one estimate the standard error of the leave-one-out cross-validation estimate of the prediction error? For each fold (leave out the $i^{th}$ observation), the LOOCV estimate of the ...
0
votes
0answers
74 views

How to calculate the variance of the leave-one-out cross validation estimator and why is it high?

I read from Elements of Statistical Learning that the leave-one-out cross validation estimator has high variance, and I read the related stackexchange posts as to why this is the case 1. But I'm ...
3
votes
3answers
122 views

Why do the ensemble learners do well on regression/classification tasks?

I was watching this short video on ensemble learners, and I am confused about why they tend to do better, and how is goodness measured. If the goodness means a low mean-squared error (MSE) as usual ...
0
votes
0answers
68 views

Bigger K for Cross validation ridge regression is better?

I do a ridge Regression and choose my Lambda via cross validation. When i set k = 10 in cross validation allways get smaller mse on test and training data set comparing to set k = 5. What is the ...