AUC in ordinal logistic regression

I'm using 2 kind of logistic regression - one is the simple type, for binary classification, and the other is ordinal logistic regression. For calculating the accuracy of the first, I used cross-validation, where I computed the AUC for each fold and than calculated the mean AUC. How can I do it for the ordinal logistic regression? I've heard about generalized ROC for multi-class predictors, but I'm not sure how to compute it.

Thanks!

I only like the area under the ROC curve ($c$-index) because it happens to be a concordance probability. $c$ is a building block of rank correlation coefficients. For example, Somers' $D_{xy} = 2\times (c - \frac{1}{2})$. For ordinal $Y$, $D_{xy}$ is an excellent measure of predictive discrimination, and the R rms package provides easy ways to get bootstrap overfitting-corrected estimates of $D_{xy}$. You can backsolve for a generalized $c$-index (generalized AUROC). There are reasons not to consider each level of $Y$ separately because this does not exploit the ordinal nature of $Y$.
In rms there are two functions for ordinal regression: lrm and orm, the latter handling continuous $Y$ and providing more distribution families (link functions) than proportional odds.
• The main issue will be how does rms calculate the $c-index$ used in Sommer's $D_{xy}$? Commented Dec 10, 2013 at 13:48
• It is spelled Somer's. The generalized $c$-index is simply computed by backsolving the equation I listed above. Internal, all possible combinations of observations having different $Y$ values are examined, and the fraction of such pairs for which predictions are in the same order is the estimate of the concordance probability. I misstated one thing: The orm function uses Spearman's $\rho$ instead of $D_{xy}$. Commented Dec 10, 2013 at 14:56
• Thanks for the spelling correction. In ordinal regression it will be much more interesting not only to look at pairwise ordering as is done in orm function you mentioned, but also look at consistent ordering ( with ternary or higher operators) depending on the number of classes you have. In summary what I am saying is: with a cumulative logistic regression fitted for example, the ordering of classes is taken care of in the model. A predictive measure should also be able not to do pairwise comparison $P(pred_1<pred_2|obs_1<obs_2)$ but comparison of the form \$P(pred_1<pred_2<pred_3|obs_1<obs_2<o Commented Dec 10, 2013 at 16:12