Questions tagged [rms]
RMS stands for 'root-mean-square' is a measure of the typical size of a varying quantity. It occurs in the n-denominator form of standard deviation (the RMS deviation from the mean)
328
questions
3
votes
1
answer
55
views
Restricted cubic splines for time-to-event data
I'm kind of new in fitting rcs for cont. variables as a clinican, so I have a few questions:
...
1
vote
0
answers
36
views
How to compute relative error of multi-dimensional time-series?
I have written a python script that uses a variety of different integrators to simulate the gravitational N-body problem. I would like to compare the positions obtained from my simulation to the ...
0
votes
0
answers
17
views
Why is taking the mean RMSE sometimes so far off overall RMSE?
I'm working with a multi-threaded program, which splits a dataset into N chunks, and evaluates some regression model's performance, predicting a score for each item in each chunk.
I'm using RMSD as ...
1
vote
0
answers
17
views
Poor RMSEA/Fit for Simple Poisson Regression
I am running a simple Poisson regression. $X$ = time, $Y$ = count data. This is a huge dataset with many years. There is significance between $X$ and $Y$. But model shows poor fit via high RMSEA value....
0
votes
0
answers
20
views
how to calculate overall RMSE accumulated during several processing steps
I have a digital terrain model (DTM) downloaded from NASA's SRTM dataset at a resolution of 1 arc second covering Spain and France. This has a stated RMSE of 9.73m [output 1]
I projected this to ...
0
votes
1
answer
30
views
How to construct an optimal spline model when two continuous independent variables are included
I am interested in evaluating the relationship between age, BMI and lipid level. The lipid level is an outcome in my study. I think that the relationship between lipid level and age and the ...
1
vote
1
answer
28
views
Comparing families of classifiers on large datasets using mixed effect logistic regression models on individual questions
I have a testing dataset of about 6000 images which I am going to try about 25 different neural networks on in a multi-class classification problem. Each network will belong to around 5 families (e.g. ...
1
vote
1
answer
64
views
Can you compare regression models using RMSE when samples have different proportions of zeros?
I am using the ranger package (which implements random forests) in R to build regression models of tree species' basal area, a continuous measure of abundance and ...
0
votes
0
answers
24
views
Compare Root Mean Square Values
I'm trying to compare a regression neural network to a commonly used equation. I have an 80:20 split for my training:test, and I get the root mean square error on the test set from the neural network ...
4
votes
1
answer
73
views
Why isn't there a square root version of the Brier score similar to how RMSE complements MSE?
When computing the mean squared error of a regression model, we get a metric in square units. For ease of interpretation, we can therefore instead compute the root mean squared error, which are in ...
0
votes
0
answers
21
views
RMS residual normalized by standard-deviation
Is there a proper name for the following misfit quantification?
misfit=√{∑[(xi−xi')^2/(n*𝜎i^2)]}
where n is the number of data points xi−xi' is the ith residual, ...
1
vote
1
answer
443
views
How to interpret interaction effect in ordinal (logistic) regression?
I ran an ordinal regression in R with the polr function from the MASS package as described in this tutorial, which is very good. However, the tutorial does not ...
0
votes
0
answers
93
views
Normalization of log-returns or normalization of cumulative log-returns
This questions seeks for discussion to find theoretical support for normalizing cumulative log-returns vs normalizing log-returns
By "normalizing" (also known as standarizing) I mean it in ...
1
vote
0
answers
92
views
Cox model with ridge term: how to choose value of theta?
The coxph() function in R package "survival" is used to fit the Cox proportional hazards model. This function allows a ridge() term in the formula to penalise selected terms, which requires ...
0
votes
1
answer
38
views
Root Mean Square Error of the addition of two measurements whose RMS Error is known
I am working on a measurement system which tries to measure the distance between two values i.e $\Delta F=F_1-F_2$. Where $F_1, F_2$ are the values I actually measure. I have set up a Monte Carlo ...
1
vote
1
answer
197
views
Can I say that the relative root mean squared error is the averaged percentage error?
RMSE is an error metric in which the mean of the data minimizes its loss function:
$\text{RMSE} = \sqrt{\frac{\sum_{t=1}^{n}(y_t - \hat{y_t})^2}{n}}$
But it gives ...
0
votes
0
answers
86
views
Cramer-Rao bound (CRB) and Root-Mean-Square-Error / Mean-Square-Error (RMSE / MSE)
My question is regarding the comparison between the CRB of a given vector parameter and RMSE/MSE obtained from Monte-Carlo (MC) simulation. The approach I used is this:
For $\boldsymbol{\theta} \in \...
3
votes
0
answers
131
views
Longitudinal RCT modeling of continuous time
I have data from an intervention study (10 clinics, 5 control, 5 treatment). The outcome is counts, and we have monthly data at baseline, treatment active phase, and post treatment phase. The number ...
1
vote
1
answer
24
views
Should the RMSE of an unrestricted VAR model decrease as compared to a restricted Autoregression model when there is Granger Causality
I have 2 time series, say for instance, T1 and T2. T1 granger causes T2 at lag 2. Should this mean that if I make a VAR model with these two time series, and an autoregression model with just T2, the ...
1
vote
1
answer
34
views
Should the RMSE of the unrestricted (VAR) model for a time series that is being Granger caused by another be lesser than its restricted counterpart?
I have a couple of time series, say, T1 and T2. I have established (using the grangercausalitytest library of Statsmodels in ...
0
votes
0
answers
77
views
(Un)Calibrated Logistic Regression Fit
I'm fitting a logistic regression on a large dataset (n=89260, 17 predictors) with a class imbalance (1% positive class). I've tried to follow Dr. Harrell's teachings so I fit my full pre-specified ...
0
votes
0
answers
10
views
Error propagation from P-V error to RMS error [duplicate]
I have a question about the Error propagation in RMS.
My surface profilometer has P-V error with 100 nm (It follows gaussian distribution).
And I investigate the z-axis positions of the object surface ...
0
votes
0
answers
35
views
problem forecasting in R using a VAR model : interpretation of characteristic polynomial roots
I have the following R code, I am fitting a VAR(10) models to a bivariate time series, comprising two variables, gaz and nuc. Yet, when trying to forecast, I had negative values, whereas my series is ...
0
votes
1
answer
82
views
Comparing RMSE values across different datasets
I am working on a PV energy production forecasting problem. With various ML models (ANN, RNN, LSTM) I am trying to predict the energy for the following day, based on the historical data.
The ...
0
votes
1
answer
121
views
Is there an error metric that decreases the weight when the target is near zero?
As precipitation prediction models can only predict positive values, they won't be able to undershoot small values by much. When it comes to overshooting, there is no boundary. High precipitation ...
2
votes
1
answer
95
views
RMSE model interpretation
Let's say I train a model and it has an RMSE of 2.5.
Does this mean, that on average, my prediction will be 2.5 away from the true value? Or does some scaling need to be done in oreder to get this ...
0
votes
1
answer
720
views
Why the results of Cox regression are different between coxph() and cph() in rms package
I found the predicted hazard (the h(t) of Cox regression) through Predict() and cph() in rms package was different from common coxph().
...
0
votes
0
answers
22
views
Obtaining 12 month ahead in sample RMSEs
I am attempting to recreate the results of the paper written by King, Stock and Watson in 1995: Temporal instability in the unemployment inflation relationship.
The paper estimates a VAR model with 12 ...
1
vote
1
answer
151
views
Cox model: how to model treatment variable when timing is unknown
We have cancer medical registry data, including information on date of diagnosis, treatment, and followup e.g. date of death etc. However, we only know type of treatment received for each person. We ...
2
votes
1
answer
656
views
Restricted cubic spline looks like a linear curve, but p for nonlinear < 0.001
I am analyzing a association between a frailty index and care needs using the cox model. I use R and use rms package to fit restricted cubic spline.
This is my R code.
...
0
votes
0
answers
91
views
ROC with bootstraping
I have a data with 2 variables: diagnosis- yes/no
Score- numeric variable from 0-10.
I need to do ROC analysis for this data and to find the best cut off values.
The problem is the data is too small ...
1
vote
2
answers
102
views
Get the R2/RMSE for each category of a dataset
This might be a dumb question !
I built a model and I'm satisfied enough with the model, given that I have a dataset with categorical variables I wanted to see the R2/RMSE for each of those categories,...
2
votes
1
answer
63
views
How do you interpret the value of RMSE/MSE in English to stakeholders?
For example, if you have a R^2 of 0.95, you can explain this number to stakeholders in a presentation as:
Our model explains 95% of the total variance within the data.
However, if we have a RMSE of 11,...
1
vote
1
answer
128
views
Why RMSE and MAPE changes with the change of axis?
I need your help regarding the information inside the picture. As you know all the information will change with the change of NDVI axis from y-axis to X-axis, except R2 and p-value remain the same? ...
1
vote
1
answer
330
views
How do we relate RMS and standard deviation for continuous signals?
Because the discrete formula for RMS, $\displaystyle X_{RMS}=\sqrt{{1 \over N}(x[1]^2+x[2]^2+...+x[N]^2)}$, is almost the same as the formula for standard deviation (assuming mean zero), except for a ...
1
vote
1
answer
23
views
What values of the independent variable do I use to compute the predicted data when calculating RMSE?
I have a data set with
x = [10 16.25 16.25 16.25 16.25 20 22.5 22.6875 24.57 24.57 41.86 47 47 53.8 66.43 77.9 91.201 96.2 97.2]
and
y = [1.28 4.15 3.42 1.53 3.44 4.89 2.91 8.51 9.03 14.91 9.73 8.07 ...
1
vote
1
answer
63
views
Summarizing a set of root-mean-squared error values
From simulation studies, I have repeated (1000) measures of the root-mean-squared-error (deviation) between a sample of observed values and the predicted value. The obtained RMSE values are, naturally ...
0
votes
0
answers
37
views
Interpret R Squared and RMSE
I am relatively new to using the MLTK app on Splunk.
When trying a number of example, I ran a regression that uses "ac_power" to predict "total-cpu-utilization". I receive the ...
1
vote
1
answer
144
views
I need help to compute the RMSE of lasso model [closed]
I was following this other example on how to find lasso regression in r . The image posted below is the image of the codes. I need help with find the RMSE
2
votes
1
answer
108
views
Is it possible to generate a scatterplot of relative hazard for participants superimposed on Cox regression line?
I have been using the rms package in R to perform Cox regression on time-to-event data. I have used the ...
0
votes
0
answers
23
views
Cross validation on bootstrap data
I am performing a dirichlet model for different species using a small sample size (between 8 to 20 samples per each).
Since my dataset is small, I bootstrap my data with 1000 iterations, averaging 3 ...
1
vote
1
answer
248
views
How to interpret R-squared versus nRMSE for a random forest model?
I have trained six random forest regression models (to predict topsoil, subsoil and total soil organic carbon stocks for two study ares) using out-of-bag validation, and I have gathered the R² and ...
1
vote
1
answer
155
views
How do we know if the RMSE values are reliable? [closed]
The root-mean-squared error(RMSE) values should be close to zero. Although the optimal value of RMSE is known as 0, we can say that it is low when RMSE =10 for the data set with high average (let’s ...
0
votes
1
answer
85
views
RMSE for model-selection
Can I use RMSE,r2 or other metric to compare models of different datasets and variables?
And if I have the same dataset but different variables?
2
votes
1
answer
57
views
Relation between validation set loss and Test loss in Machine learning
I am very new to Machine learning. I am trying to implement a feedforward neural network to predict release year of songs based on some audio features.
I have a train.csv file and dev.csv file. I use ...
2
votes
1
answer
474
views
Using bootstrapping to calculate the AUC of a ridge regression model
Edit:
I have a RNA-seq dataset with 8k genes and 100 samples (60 samples with disease condition 1 and 40 samples with disease condition 2) and I am trying to predict a dichotomous disease status.
I'd ...
1
vote
1
answer
655
views
A Higher r-squared always implies a reduction in MAE and RMSE?
I apply 2 different machine learning models in my data, a Multiple Linear Regression and Random Forest. The results were bellow:
Why the MAE and RMSE are higher for a higher R-squared? Both models ...
1
vote
1
answer
63
views
RMSE and R2 with different training splits
I am running 2 linear regression models using the same data with different data splits. n=205
70/30 split
RMSE: 2341
R2: 0.85
50/50 split
RMSE: 2474
R2: 0.88
Seems counterintuitive that the R2 ...
2
votes
0
answers
106
views
How to interpret RMSE with scaled values vs ground truth values
I've trained an LSTM model and am measuring RMSE. I know how RMSE is interpreted normally, but I'm a a little confused on how to interpret the RMSE value when I have scaled my features and target ...
1
vote
1
answer
311
views
Percentage change in RMSE (or MAE) over models
Let's say I have two different models of an outcome Y, m1 and m2 and perform some kind of cross-validation.
I calculate the RMSE and the MAE on the test set (for the two models) and I want to say ...