Skip to main content

Questions tagged [hosmer-lemeshow-test]

The Hosmer-Lemeshow test is a test for goodness of fit in binary classification. It is typically used in the context of logistic regression. Note that the Hosmer-Lemeshow test is now considered obsolete.

Filter by
Sorted by
Tagged with
0 votes
1 answer
76 views

Applicability of the Hosmer-Lemeshow test

Description To test the goodness of fit of modelled event probabilities $\bar{P}=\{P_{1},...,P_{g}\}\in(0,1)^{G}$ for binomially distributed $G\in\mathbb{N}^{+}$ grades, I’ve applied the HL (Hosmer-...
CorrieElba's user avatar
0 votes
1 answer
38 views

Hosmer-Lemeshow Calibration error when predicted probabilities are clustered

I have extracted predicted probabilities (logistic model) from a graph according to the nine classes of a certain variable (I don't own the model). I need to compare the predicted probabilities, that ...
vixxovs's user avatar
  • 45
1 vote
1 answer
84 views

very low hosmer and lemeshow goodness of fit in logistic regression

I am currently working on my masterthesis. Therefor i want to perform a logistic regression (with logit link funtction) to predict the degree of encoded registrations in gp practices (coded ...
Justine Soetaert's user avatar
2 votes
2 answers
69 views

Importance of goodness of fit in Hypothesis testing

I am struggling with one question. Is goodness of fit of a model necessary when your purpose is to test hypothesis regarding a coefficient? To be specific, I am regressing formal credit access on ...
Rupon's user avatar
  • 21
2 votes
1 answer
195 views

Can Hosmer-lemeshow chi-square statistic explain calibration?

I'm doing a logistic regression and created a calibration plot. I also conducted a Hosmer-Lemeshow test and got the corresponding chi-square. Is there any relationship between the calibration plot and ...
user10386405's user avatar
0 votes
1 answer
157 views

Goodness of fit test for predictive model with small sample size

I am new to building the prediction model and would like to hear from you regarding the goodness of fit test (model calibration). Between Akaike information criteria (AIC), Hosmer-Lemeshow Test, ...
R Beginner's user avatar
0 votes
0 answers
136 views

Why does my logistic regression model fail the Homer and Lemeshow's test?

I apologize in advance if my questions seem incredibly dull. Trying to teach myself Stata before I get to grad school as someone who's brain is very much not made for handling statistics. So trying to ...
Joel's user avatar
  • 1
0 votes
1 answer
158 views

Where to start: own simulations on logistic regression. Hosmer-Lemeshow, Farrington, Pearson Chi-Square [closed]

I'd like to run my own simulations on the logistic regression model. I want to test on different grouping strategies, spare data and strategies for combined small groups. I read a lot of papers by ...
Toby's user avatar
  • 416
1 vote
0 answers
3k views

What is the accurate null hypothesis for the Hosmer-Lemeshow test?

I've read some works on the Hosmer-Lemeshow test (HLT) but still I'm uncertain what is the exact null hypothesis for the HLT. I'd like to formulate a nullhypothesis as precisely as possible. I think ...
Toby's user avatar
  • 416
6 votes
0 answers
221 views

What are the pros and cons of different metrics for evaluating a logistic regression model?

In the data science world, I have always evaluated the performance of logistic regression models simply using ROC/AUC. However recently, I've read from some traditional statistics source about some ...
CPT's user avatar
  • 461
5 votes
1 answer
466 views

Hosmer-Lemeshow recommendations

During lectures I came across following statement: If you want Hosmer-Lemeshow test to be valid, number of expected events ($E_1g$) should be >5 in most of $g$ groups Then after few lectures, ...
mokebe's user avatar
  • 273
0 votes
0 answers
367 views

binary logistic regression with large sample size [duplicate]

I try to make a binary logistic regression model from 85871 samples. I used enter method. There are seven explanatory variables and all of them have significant in Wald Test. But, in Hosmer Lemeshow ...
vanny septiana's user avatar
0 votes
1 answer
392 views

Hosmer Lemeshow (1980) Paper - Theorem 2

In Hosmer and Lemeshow's 1980 paper, Theorem 2 states that the asymptotic distribution of $\hat{C}^*_g$ (the usual Hosmer-Lemeshow test statistic) is \begin{equation} \tag{1} \chi^2_{2g-g-(p+1)} + \...
Math321's user avatar
3 votes
0 answers
3k views

Interpretation of Hosmer Lemeshow (goodness-of-fit) Test from rms package

I applied a Hosmer-Lemeshow-Test (now named only goodness-of-fit?) provided by the RMS Package by Prof. Harrel. The p-values for my model were not significant, therefor applying the following link: ...
Nuke's user avatar
  • 97
0 votes
0 answers
818 views

Goodness-of-fit vs maximum likelihood for logistic regression?

From what I understand, maximum likelihood is used to estimate a parameter alpha in a way that maximizes the probability P(Y=|x,alpha) for example. It is used for logistic regression in order to get ...
engineering student's user avatar
1 vote
2 answers
2k views

Hosmer-Lemeshow goodness of fit test, P=1?

I'm trying to perform a Hosmer-Lemeshow goodness of fit test on a bunch of logistic regression models but for some reason the p-value that is returned is 1 on all of the models. Does anybody have a ...
Janono's user avatar
  • 443
5 votes
1 answer
847 views

Hosmer-Lemeshow GOF test in Matlab

I am trying to calculate the Hosmer-Lemeshow Goodness-of-Fit (GOF) test, following the steps presented in the book "Logistic Regression. A Self- Learning Text" by David Kleinbaum and M. Klein. The ...
ouranos's user avatar
  • 529
3 votes
1 answer
1k views

Why isn't Hosmer-Lemeshow test used for other models besides Logistic Regression?

I've only seen the Hosmer-Lemeshow test used for Logistic Regression. Why can't it be used for algorithm that produces probabilities for binary classification? ...
makansij's user avatar
  • 2,289
1 vote
0 answers
76 views

When to use predictive power versus when to use model fitting metrics?

I built a binary classifier using logistic regression. But I can't seem to rationalize this in my mind. After cross validation, the model's AUC is 0.9003. But, as a sanity check, I ran a GOF (...
makansij's user avatar
  • 2,289
3 votes
3 answers
1k views

Is the distribution of the test statistic for the Hosmer-Lemeshow test $\chi^2$ in ''out of sample validation''?

The Hosmer-Lemeshow test has some inconveniences and I am well aware of it. But assuming that I want to apply it then I read that (e.g. Applied logistic regression, by Hosmer and Lemeshow) the test ...
user avatar
7 votes
1 answer
6k views

Hosmer-Lemeshow test in R

The Hosmer-Lemeshow test is a statistical test for goodness of fit for logistic regression models. According to ?hoslem.test, it deals only with binary logistic ...
Yang Yang's user avatar
  • 214
1 vote
1 answer
364 views

Hosmer Lemeshow for correlated data

Is it OK to use HL to judge the goodness-of-fit of a Logistic Regression when the data is a time series correlated from one period to another? I know that HL assumes independence of events, but I ...
user93611's user avatar
15 votes
1 answer
9k views

Goodness-of-fit test in Logistic regression; which 'fit' do we want to test?

I am referring to the question and its answers: How to compare (probability) predictive ability of models developed from logistic regression? by @Clark Chong and answers/comments by @Frank Harrell. ...
user avatar
34 votes
2 answers
5k views

Degrees of freedom of $\chi^2$ in Hosmer-Lemeshow test

The test statistic for the Hosmer-Lemeshow test (HLT) for goodness of fit (GOF) of a logistic regression model is defined as follows: The sample is then split into $d=10$ deciles, $D_1, D_2, \dots ...
user avatar
2 votes
1 answer
652 views

Hosmer-Lemeshow test with weighted data

I am trying to perform Hosmer-Lemeshow test on weighted data (i.e. each observation in a data set has its weight). Unfortunately, I cannot find any literature on how to perform such test. Do you know ...
kuba's user avatar
  • 181
6 votes
1 answer
1k views

Is the goodness of fit test in JMP the Hosmer-Lemeshow goodness of fit test?

I'm working with an organization that is using JMP in their analysis, and I can't tell from the description in JMP's help files if the test for goodness of fit in their logistic regression is the ...
Zaralynda's user avatar
  • 305
15 votes
1 answer
8k views

Hosmer-Lemeshow vs AIC for logistic regression

If the Hosmer-Lemeshow indicates a lack of fit but the AIC is the lowest among all the models....should you still use the model? If I delete a variable, the Hosmer-Lemeshow statistic is not ...
Thomas's user avatar
  • 403