5
$\begingroup$

I am familiar with ordinal regression and quantile regression at a high level, but would like a deeper understanding of the two beginning on how they differ. Can someone compare and contrast the two, perhaps with a reference(s) to an article that compares them? TIA

$\endgroup$
1
  • 3
    $\begingroup$ Quantile regression is used with quantitative variables and a lot different from ordinal regression that deals with ordinal variables. They are very different, how do you see a comparison to be made between them? $\endgroup$ May 11, 2022 at 9:54

1 Answer 1

4
+50
$\begingroup$

Chapter 15 of the second edition of Frank Harrell's Regression Modeling Strategies textbook and chapter 11 of the most recent version of his class notes provide succinct comparisons. Either ordinal (e.g., via the orm() function of the rms package) or quantile regression methods can model continuous outcomes, so a comparison does make sense.

Quoting from pages 360 and 361 of the textbook:

Quantile regression... makes no distributional assumptions other than continuity of $Y$, while having all the usual right hand side assumptions... Using quantile regression, we directly model the median [or any other quantile] as a function of covariates so that only the $X\beta$ structure need be correct.

A different robust semiparametric regression approach than quantile regression is the cumulative probability ordinal model...While quantile regression has no restriction in the parameters when modeling one quantile versus another, ordinal cumulative probability models assume a connection between distributions of $Y$ for different $X$. Ordinal regression even makes one less assumption than quantile regression about the distribution of $Y$ for a specific $X$: the distribution need not be continuous. (Emphasis added, to highlight a major difference from quantile regression.)

A semi-parametric ordinal regression model "contains an intercept for every unique $Y$ value less one" (legend to Table 15.1 in the textbook) and assumes a link function that provides the further association with covariates $X$ (Equation 15.2):

$$ \text{Prob}[Y \ge y_i|X]= F (\alpha_{y_i} + X\beta).$$

Typical quantile regression requires no such assumptions. There's a variant of quantile regression that restricts predictor coefficients to be the same across multiple quantiles (see footnote b on page 361), however, so the distinction isn't necessarily that sharp.

I understand that quantile regressions are typically fit via linear programming, while ordinal regression uses maximum likelihood. That's also not such a strict distinction, however, as quantile regression can be formulated as maximizing the likelihood for Laplace-distributed errors.

$\endgroup$
1
  • 1
    $\begingroup$ Thanks for the nice summary :-) In addition, quantile regression is not very efficient for non-large N. In the case where there is only a single binary X (the two-group problem) quantile regression is identical to stratified sample quantiles which are not very efficient. $\endgroup$ May 15, 2022 at 21:55

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.