Diagnostic measures (such as residuals or some summary statistics calculated from residuals) are used to evaluate some aspect of quality of model fit to data.

learn more… | top users | synonyms (1)

3
votes
0answers
111 views

Can I compare different estimations approaches with AIC?

I'm running two different panel models. Model 1 is a Random Effects regression estimated using Maximum Likelihood and bootstrapped standard errors. Model 2 has the same main dependent variables and ...
2
votes
0answers
38 views

Independence of “residuals” in a Bayesian multilevel hierarchical model

So i'm having some problems realising what model checks I should do after fitting a bayesian model other than convergence diagnostics. Lets say i'm fitting a hierarchical bayesian regression model, I ...
0
votes
0answers
84 views

Practical beginners resource for building a dynamic OLS model

I need to model the current account balance of a country. The regressors are the real effective exchange rate, the domestic GDP and the GDP of the world. I am using data for 30 years (in logs). It is ...
1
vote
2answers
62 views

What visualizations do people use to debug a machine learning model?

Imaging I am refining a model. What visualization can I rely on to help me identify an error, e.g. feature deficiency, data bias? A few graphs I am aware of include: confusion matrix, ROC, learning ...
1
vote
1answer
46 views

Questionable diagnostics for a binary logistic model

The model including one binary outcome (0/1; incident rate ~1.2%), one main exposure, and 13 covariates. The whole model is significant and the goodness-of-fit is OK. However, model diagnostic is ...
3
votes
1answer
186 views

How can we have non-random patterns in the plot of simple linear regression residuals vs the predictor variable?

A) When considering a simple linear regression model, it is important to check the linearity assumption. Graphing the residuals vs the predictor variable can often give a good idea of whether or not ...
1
vote
0answers
51 views

How to distinguish suspicious leverages?

Given a linear model and the following hatvalues and influence.measures, how can I say which measurements are suspicious? I mean ...
0
votes
2answers
176 views

Test for endogeneity in regressions model?

In a regression model are there tests to detect the possibility of endogeneity in the model? For example, we have the White's test for heteroskedasticity. Is there something for endogeneity?
4
votes
0answers
78 views

what to do with ridiculous but valid leverage points

So I'm having some difficulty fitting a linear model to the data (see other post here glm model fit - can't find a family/link combination that produces good fit). In particular, I'm worried ...
1
vote
1answer
55 views

Definition of 'Model Diagnostics'

Can anyone help me out with explaining what the term 'model diagnostics' refers to when applied to multiple regression please? In particular, what tests are necessary to check whether your estimated ...
5
votes
1answer
2k views

How to manually calculate dfbetas

I am trying to replicate what the function dfbetas() does in R. dfbeta() is not an issue... Here is a set of vectors: ...
0
votes
0answers
243 views

Arima Models Diagnostics

I'm doing a forecasting using seasonal ARIMA method. I'm using astsa package in r and I'm testing two models that I can't decide which one is better to use than the other The ACf and PACF for the ...
0
votes
2answers
168 views

What does 8.6e-28 mean in the result from a White Test testing for heteroscedasticity?

I used a White Test for testing the homoscedasticity assumption of the linear regression I am working on. I have a problem with the interpretation as I have a result from the test in which the p-value ...
3
votes
1answer
375 views

Interpreting case influence statistics (leverage, studentized residuals, and Cook's distance)

I just wanted to clarify some things about leverage, studentized residuals, and Cook's distance: Does a large (in absolute value) studentized residual mean that a case is an outlier? Does a large ...
1
vote
0answers
22 views

I want to compare two calibrations with R… But cannot find the right answer

I first want to precise that I spent 2 hours searching for an answer, couldn't find something that was answering my question. So basically, I ran two calibration with my diagnostic test, so I ...
3
votes
1answer
790 views

How to interpret the direction of the Harvey-Collier test and Rainbow test for linearity?

I implemented both those tests with R, using the lmtest package. Both tests directionally say the same thing (I think) with a very similar p-value of very close to 0. But, are those tests saying ...
2
votes
0answers
41 views

How to proceed with nonstationary variables in panels?

In most of the emprical papers using panel data, authors do not seem to "worry" too much aboout the non-stationarity of the individual variables. Yes, there is asymptotic theory for N and T going to ...
1
vote
2answers
618 views

Normality of residuals - contradiction between 'symplot' and 'qnorm'?

After running a multiple linear regression analysis, I wanted to assess normality of residuals. I plotted a histogram which showed an almost normal distribution of residuals. I also used ...
2
votes
2answers
402 views

Are the model residuals well-behaved (homoscedasticity)?

Can I say looking at this residuals-vs-fitted plots, that my residuals are homoscedastic?
1
vote
0answers
44 views

How do you approach transformations when modeling?

I'm working with a simple univariate dataset and I've built several models for it. Some I think are fairly decent given that datas structure. In order to get a decent model I had to do some ...
2
votes
1answer
505 views

Diagonal lines in residuals vs fitted values plot for ANOVA

I'm experiencing strange patterns of residuals. The following chart is a scatterplot of Standard residuals (Sres) versus Fits. I'm interested in the diagonal lines that mean that a higher fit leads to ...
3
votes
1answer
257 views

What are the three forms of the Park test for heteroskedasticity?

I understand the Park test for heteroskedasticity has three different forms. The best known one is in a log form: LN(Residual^2) = intercept + slope (LN(X)). The second one is in a linear form: ...
0
votes
2answers
145 views

If the model fits well, nothing can be done?

I am playing a data without any background information. First, I try multiple linear regression. The model fits well, since the $r^2$ is larger than 90%. I deleted several variables by AIC. The fits ...
1
vote
0answers
149 views

What convergence diagnostics are appropriate for a Bayesian hierarchical logistic regression model?

Using WinBUGS, I fit several Bayesian hierarchical logistic regression models for the mean of a binary response variable conditional on a set of criteria. I am now using CODA in R to determine if my ...
1
vote
0answers
99 views

R lmer Model Diagnosis qqnorm

I fitted this lmer model: m1 <- lmer(logR ~ N_g.m.2 * Year + (1|Wh/N_g.m.2), data = CO2_Ratio) Rendering the attached qqplot. ...
2
votes
0answers
47 views

Refining “good” mixing time estimate

Fix a Markov chain $\{ X_{t} \}_{t \in \mathbb{N}}$ with mixing time $\tau_{\mathrm{mix}}$. Assume that I know some finite bound on the mixing time $\tau_{\mathrm{mix}} < \tau < \infty$, and ...
8
votes
2answers
2k views

Residual Diagnostics and Homogeneity of variances in linear mixed model

Before asking this question, I did search our site and found a lot of similar questions, (like here, here, and here). But I feel those related questions were not well responded or discussed, thus ...
5
votes
1answer
171 views

Are normally distributed residuals not necessarily homoskedastic?

Let's say I've ran a linear regression and I'm checking the model diagnostics. I made a histogram of the residuals and they appear more or less normally distributed as below. I thought for a long ...
3
votes
3answers
112 views

Too many predictors to manually check linearity

Say I have 1000 potential predictors in a logistic regression. I don't have time to check each predictor manually for linearity. I could wait till after variable selection, but in that case I wonder ...
0
votes
0answers
78 views

Diagnostics for the analysis of variance model

I have problem with the diagnostic of the one way analysis of variance model (fitted in R). I've checked all the assumptions of the analysis of variance 1) "For each level of the within-subjects ...
1
vote
0answers
252 views

Model assumptions and diagnostics for proportional hazard regression model with frailty in R

I am wondering are there any assumptions that must be met in the proportional hazard regression model with frailty? I remember that in regular proportional hazard model without frailty all variables ...
2
votes
2answers
1k views

Is residuals autocorrelation always a problem?

I read that OLS underestimates variance when residuals are autocorrelated. I see why autocorrelation would be a problem in time series analysis, in the sense that the coefficient are not efficient ...
1
vote
0answers
299 views

VECM Diagnostic Test

I have got few questions about VECM and cointegration test. Basically I conducted a cointegration test on two time series (spot vs forward price) by using the Johansen procedure. The results suggest ...
3
votes
1answer
1k views

What resolution should I be using for residuals vs fitted values plot from a linear regression?

I made this linear regression that shows how well estimated animal locations (longitude) predict actual animal locations. ...
4
votes
1answer
104 views

Geweke diagnostic of a Markov chain: why does the first window have to cover the burn-in?

I read the following statement in this document$^{[1]}$, at the bottom of page 11: Too wide A will some times “hide” the burn in part within the converged part of the chain and the difference in ...
2
votes
2answers
1k views

How to compare the positive predictive value and negative predictive value of two diagnostic tests?

Im a surgeon who's trying to compare two diagnostic tests that are used to diagnose appendicitis. Two diagnostic tests were applied on 150 patients and the results were compared to a gold standard. I ...
5
votes
1answer
425 views

Is the goodness of fit test in JMP the Hosmer-Lemeshow goodness of fit test?

I'm working with an organization that is using JMP in their analysis, and I can't tell from the description in JMP's help files if the test for goodness of fit in their logistic regression is the ...
3
votes
0answers
65 views

Verification of assumptions in TBATS model

I have a question about using BATS/TBATS models implemented in the forecast package for R. In De Liv­era, Hyndman & Snyder (2011) the models are used without any following analysis. Is it OK to ...
3
votes
1answer
119 views

How to treat this OLS based on residual diagnostics

I am struggling already a couple of days with this simple OLS, can you help? Outcome years in function of predictor score, very simple linear model. The residual plot does absolutely not look good ...
25
votes
4answers
1k views

Why does my bootstrap interval have terrible coverage?

I wanted to do a class demonstration where I compare a t-interval to a bootstrap interval and calculate the coverage probability of both. I wanted the data to come from a skewed distribution so I ...
1
vote
0answers
106 views

What plots should be used for diagnostics for linear mixed model?

Before fitting a linear mixed model, can any plots be used to show a random intercept/slope is justifiable in the model? I.e. these plots may indicate a different pattern for each individual over time....
1
vote
0answers
70 views

Help in interpreting AUC values from ordinal variables

I would appreciate if someone could explain to me the benefit of using area under ROC for evaluating agreements between two raters. Here is an example from two raters on, let's say, clinical time ...
1
vote
0answers
58 views

Simulation for model checks for sample size

In the book Bayesian and Frequentist Regression Methods, Wakefield notes that estimators for coefficients in a linear model will be normal if the error terms are normal or if the sample size is ...
1
vote
1answer
283 views

Visually inspecting normality of variables

I'm using R to plot some graphs for visually inspecting the normality of variables that will go into a linear regression model. Except for a histogram and a QQ plot, what other graphics could I use?
4
votes
1answer
718 views

What diagnostics for random effects logistic regression?

I'm wondering what checks/diagnostics you usually calculate and report if you do a random effects logistic regression. C-statistic/ROC curve Check multicollinearity? Check heteroscedasticity? ...
11
votes
1answer
389 views

Why are diagnostics based on residuals?

In simple linear regression one often wants to verify if certain assumptions are met to be able to do inference (e.g. residuals are normally distributed). Is it reasonable to check the assumptions ...
1
vote
0answers
204 views

Has anyone written a package in R to calculate diagnostic plots after clogit (conditional logistic regression)? e.g. leverage

Has anyone written a package in R to calculate diagnostic plots after clogit, conditional logistic regression? e.g. leverage. Or ...
4
votes
0answers
603 views

Diagnostics for GEE in R

I have been checking out which diagnostics to use for a GEE analysis. It seem that influence measures are appropriate (Preisser, 1996). Does anyone know of a package that can be used in R to examine ...
2
votes
2answers
1k views

does rstandard standardize in z?

I'm new to R, so please be gentle. I was under the impression that rstandard(model) returns the z-scores of the residuals in ...
3
votes
0answers
473 views

How to compute sample size to compare two diagnostic tests

I will be performing two diagnostic tests (one is the gold standard, one is novel) on the same subject aiming to establish sensitivity, specificity, PPV and NPV. What formula may be used to compute ...