The residuals of a model are the actual values minus the predicted values. Many statistical models make assumptions about the error, which is estimated by the residuals.

learn more… | top users | synonyms (1)

0
votes
0answers
19 views

beta regression creating a wild residual vs. fitted plot- whats going on?

I recently ran a beta regression model in R using the betareg package. I am modeling a continuous dependent variable (a fraction out of 1) that is bound between 0 ...
0
votes
0answers
17 views

How to export my residual data? [on hold]

I am having a lot of trouble simply trying to export my residual data. I'm new to R so not sure what I'm doing wrong. I've tried doing library(xlsx) write.xlsx(Residuals, "c:/ResidualsData.xlsx") ...
0
votes
0answers
7 views

Creating a meaningful metric from a multiple regression residual

I want to show a scatter plot and accompanying best fit line for a regression equation I am using for, say, number of cigarettes smoked (x-axis) predicting visible skin blotches (y-axis). A ...
1
vote
0answers
9 views

Continuous, sometimes negative residuals from Poisson-distributed variable - how to analyze?

It's been years since I've taken my grad school stats courses, and it's a subject I struggle with, so bear with me. I am attempting to analyze a dataset containing two Poisson-distributed variables ...
0
votes
0answers
7 views

interpreting residual plot from nonlinear mixed effect model

I am developing a nonlinear mixed effect model to model selectivity of a survey gear. I have worked through Mixed Effect Models in S & SPlus and Nonlinear Regression with R to learn how to model ...
0
votes
0answers
19 views
1
vote
1answer
42 views

How to studentize residuals

The lecture slide (from PennState Eberly College of Science, STAT 501, Lesson 11.3) says "an ordinary residual divided by an estimate of its standard deviation", but the standard deviation for ...
3
votes
3answers
74 views

Why does the sum of residuals equal 0 from a graphical perspective?

I've seen the proof for why in least squares regression the sum of residuals is always equal to 0, and I kind of understand why from that algebraic perspective. Basically, you're finding the minimum ...
3
votes
0answers
28 views

What do my residuals say about my data?

I am new to R and I am trying to find a relationship between Wing length (mm) and Weight (g) of black-capped chickadees using a data set of over 4000 data points. I did a regression analysis and ...
0
votes
0answers
28 views

X-13 Seasonal Adjustment trading day peak in regarima residual

I have a time series of air passengers with a total of 143 monthly observations. Having done the seasonal adjustment using X-13-ARIMA-SEATS, the final diagnostics seem to suggest that the seasonal ...
0
votes
0answers
23 views

Mean square error of residuals

On page 15 of "An Overview of Predictive Learning and Function Approximation," Friedman claims that with the standard linear regression model in $\mathbb{R}^d$ (the true model $f(x)$ is linear, errors ...
0
votes
1answer
27 views

Definition of residuals versus prediction errors?

I always thought the definition of residuals is the difference between the statistic and the observations. And, the definition ...
0
votes
1answer
38 views

DCC GARCH model diagnostics in R

I have fitted a DCC GARCH model to my multivariate financial data. So, now I need to check the fitted model by using the standardized residual and its squared process. A good fitted model should have ...
3
votes
1answer
62 views

Off-diagonal elements of a correlation matrix after removing the first principal component

I have some data with more variables than observations, that I'd like to subject to a principal components analysis. For didactic reasons (to give an intuition for factor retention criteria under ...
0
votes
2answers
33 views

Regression Analysis — Correlation of Residuals

I see a lot of info on how to detect correlation of residuals and why it might negatively impact the quality of our model. I however dont see much info on how to mitigate the bad effects of these ...
0
votes
0answers
16 views

Differences in regards to standard deviation

Hi I'm having trouble figuring out the differences in calculating the standard deviation of a data set and the standard deviation of its residuals?
0
votes
0answers
16 views

Test for Conditional Normality?

On page 357 of this article, it states: We assume that the treatment (or its transformation) has a normal distribution conditional on the covariates. How would I go about determining if a ...
0
votes
1answer
29 views

Why does adding a time index variable help with a trend in errors?

I was reading through this example of a regression model fit to beer sales data link. After the log transformations on the data (which make sense how they correct for the compoundingly larger variance ...
1
vote
0answers
52 views

Mitigate autocorrelation in time series with AR(2) process

I have a dataframe with 4000 companies and I have calculated a liquidity measure of each of the company in the dataframe. Liquidity is highly persistent. And my analysis shows that in these indiviual ...
1
vote
0answers
23 views

Residuals of logistic regression and detecting outlying observations

Is it correct to say that the residuals of logistic regression in practice have a bimodal distribution? And how would this make it harder to detect outlying observation?
1
vote
0answers
17 views

Correction for non-normal residuals where residuals are not correlated or show heteroskedasticity

I know the implication of non-normal residuals is uncertain statistical tests because the SEs are inefficient. Can I apply the Newey-West to calculate standardized Standard Errors for an OLS ...
5
votes
2answers
407 views

Why do residuals in linear regression always sum to zero when an intercept is included?

I'm taking a course on regression models and one of the properties provided for linear regression is that the residuals always sum to zero when an intercept is included. Can someone provide a good ...
3
votes
1answer
23 views

Where do deviance residuals come from?

I'm trying to understand deviance and deviance residuals using a simple Poisson regression model as an example. Let's say we have a response variable $$ y_i \sim \text{Pois}(\lambda_i)$$ and we assume ...
0
votes
0answers
39 views

What causes bands/stripes in residual plots?

I ran a model and got the following residuals: I proceeded to log the fitted values to get an idea of what's happening at the lower end of my predicted values: It was then I saw on the left side ...
0
votes
1answer
12 views

same variances of the error terms of residual analysis?

The text book says the residual diagram suggests that the variances of the error terms are equal.But how the variances of the error equal?As You can see the variance on the right circle is greater ...
1
vote
1answer
49 views

Implementing logistic regression (R)

I am implementing a logistic regression on a 250 x 20 dataset (250 observations of 20 variables) with a dichotomous response. In this proces I have encoutered some different problems, namely: 1. ...
2
votes
0answers
36 views

Residual's plot interpretation

These are plots created in R. All of them are residuals (errors) vs. fitted values. They come from multiple linear regression models fitted by least squares. The five plots represent 5 different ...
3
votes
1answer
33 views

Tilted rectangle in residuals vs fitted plot

When performing diagnostics on an OLS model, what can make a plot of the predicted responses vs the residuals. Ideally we want a horizontal rectangle shape. But what does it mean when the plot is a ...
0
votes
0answers
17 views

Estimating unexplained variance from multivariate probit output (for imputation protocol)

I have a use case in which survey data underreports program participation, and I need to impute new recipients from within the survey data. There are two (exogenously provided) sub-objectives: ...
0
votes
0answers
14 views

TReading Residual Plot: Omitted Variable Bias of Dummy Variable

I have a plot of the residuals versus fitted values of an OLS model such that the shape of the plot are two identical randomly scattered clouds, one above and one below the $\hat{e} = 0$ line. Can I ...
0
votes
0answers
12 views

High residual reproduced correlations in factor analysis vs sample size

I am a Psychologystudent who had to execute a survey for her study. The criteria where that I had to have at least 25 people and that every scale would have at least 5 and maximum 10 items. My survey ...
0
votes
0answers
32 views

Calculating Multiple R-squared from Adjusted R-squared

I need to calculate Multiple R-squared knowing only adjusted R-squared and the number of predictors, not the number of observations within given data. However, I know (1) residual standard error, (2) ...
1
vote
0answers
32 views

Is there a theoretical distribution for the residuals of a logit/probit regression?

I know there are a number of ways to define residuals for logit/probit regression but is there any theoretical distribution? I've also heard these residuals can be bimodal so maybe there is no closed ...
2
votes
1answer
35 views

Interpretation of covariance estimates glmm (proc glimmix)

I am using the glimmix procedure in SAS to model a generalize linear mixed model with and binomial distribution and a logit link function. I am modeling both the G-side and the R-side covariance ...
0
votes
0answers
43 views

Using residuals as a dependent variable (multiple times)

Probably a noob question, but does it even make sense? Let's say I have several 2-3 independent variables pools and I want to take independent variables from each pool and regress them agains the ...
0
votes
0answers
21 views

Residuals from a mixed effect model

I'm running a beta-binomial mixed effects model that estimates the effect size (B) and partitions variance into a random effect (g) and error (e). I would like to calculate the residuals (e), but only ...
10
votes
1answer
212 views

Diagnostics for generalized linear (mixed) models (specifically residuals)

I am currently struggling with finding the right model for difficult count data (dependent variable). I have tried various different models (mixed effects models are necessary for my kind of data) ...
0
votes
0answers
9 views

normality tests of residuals in repeated measures design

I have a repeated measures design where I have plotted the residuals and the majority of my data are not normally distributed. As I understand it, repeated measures designs are quite robust when using ...
0
votes
2answers
54 views

How are the values of residuals (white noise) calculated in ARMA model?

I am trying to implement ARMA model in Java. I have trouble with calculating residuals (white noise) in Moving average part of the model. From the answer on this question (Fitted values of ARMA model) ...
1
vote
0answers
46 views

Shouldn't the root mean square error (RMSE) be called root mean square residual?

As far as I understand, estimating the error of a model, say an artificial neural network, requires to know the "true" model. Wikipedia says in its article "Errors and residuals": "The error (or ...
0
votes
0answers
25 views

Estimating Studentized Residuals (or Another Similar Measure) After Linear Regression With Robust Standard Errors

I have estimated a linear multiple regression with robust standard errors using Stata (regress depvar indepvar1 indepvar2 indepvar3 indepvar4 indepvar5, robust). ...
2
votes
3answers
110 views

VAR model residuals having significant correlation at lag 12

I have tried to fit a VAR model for two stationary time series dlogsl_ts and dlogllc_ts(tested by PP test and ADF test), the ...
1
vote
0answers
50 views

Why is my logistic regression fit that bad?

I was requested by a professor to analyze a high dimensional dataset (92 cases, 400+ variables, and a lot of NAs...) of various patient outcomes (gaussian distributed, counts, and binary) and their ...
7
votes
2answers
126 views

Where is the explanatory effect of common variance among covariates accounted for in regression procedures?

As a follow up to the excellent answers provided for: Does the order of explanatory variables matter when calculating their regression coefficients? (Which I've found incredibly useful from a ...
0
votes
0answers
27 views

Residual plot looks like inverted change plot for prediction model

I have a very big problem with my predictive model. What i essentially do is that I predict the volume in a tank by studying the flow into and out of the tank. I use the two flows to construct a ...
3
votes
1answer
87 views

Interpretation of residuals vs fitted plot

I am checking that I have met the assumptions for multiple regression using the built in diagnostics within R. I think that from my online research, the DV violates the assumption of homoscedasticity ...
0
votes
1answer
36 views

Multiple regression - Interpreting the plots

I used the inbuilt dataset stackloss here. I used following R code for creating the multiple regression model. ...
1
vote
0answers
63 views

Non-normality of residuals in a negative binomial GLMM

I am testing for the effect of treatment and fish length on the school size of fish. Treatment is a categorical variable with two levels (e.g., treatment A & treatment B). Fish length is ...
1
vote
0answers
21 views

Problems in finding outliers and leverage points in non-linear regression

I'm implementing diagnostic of non-linear regression model $(y=ax^b)$. I'm trying to find out where outliers and leverage points in my model ...
2
votes
1answer
80 views

Check for White Noise Residuals for AR(1) Model

I was going through the SAS documentation for PROC ARIMA and got stuck at this point. ...