# Unexpected singularities in the Hessian matrix error in multinomial logistic regression

I have been doing multinomial logistic regression analysis using SPSS 19. I have encountered the following problem when I run the analysis procedure:

"Unexpected singularities in the Hessian matrix are encountered. This indicates that either some predictor variables should be excluded or some categories should be merged."

A little background about my data used. I have four categorical predictors with two levels each, 1 or 2. The response variable in my model is a three-level categorical variable. I used the last level as the reference category. I tried to compare the coefficients of the intercept with that of the four predictors in the two logits so as to find which level of the response variable may cause this problem. The big differences in coefficients between the intercept and three of the predictors suggest that it might be the reference category that has the problem. However, I could not combine the levels of the response variable (which I'm not allowed for my research).

I have also tried to exclude the predictors one by one, but still got the same problem.

Could anyone please tell me what I should do to solve this problem?

• A first check would be to calculate the rank of your design matrix. If it's less than the number of columns, you probably need to combine and/or recode appropriately. Apr 29, 2011 at 16:47
• Given that all variables are categorical, one alternative option is to use contingency table methods. I.e. you have a five way contingency table. This can be done using a poisson glm (log-linear model), which may be more stable (may not be though). Could also be a "separation problem" - your response can be perfectly predicted from the covariates - makes computers freak out when this happens because variance is zero. Apr 30, 2011 at 11:01
• Actually, combining levels of the response variable is a recommended way to approach problems in multinomial logistic regression. By combining the lower two levels and then the upper two levels you can approximate the multinomial results by means of two (simpler) logistic regressions. These logistic regressions and their diagnostics might indicate what's going wrong.
– whuber
Jun 29, 2011 at 15:59