11
$\begingroup$

I have some ordinal data that is not normally distributed, so I decided to do non-parametric testing using the Mann-Whitney U Test. I am looking at differences between groups for seven scores - these scores are either 0, 1, 2, or 3 for each subject. I am having a difficult time figuring out how to display my data!

If I present the data using the medians (and IQR of medians), it's not clear at all where the differences are because for the most part the medians fall on either 0 or 1. So despite the Mann-Whitney U Test showing significant differences, the table just looks uninteresting.

I could also present the data using the means. There are some scientific papers out there which say that you can use means with ordinal data, but that you can't make the same type of assumptions about differences between scores (e.g. the difference between 0 and 1 is not the same as between 1 and 2). Using means would be a bit controversial, although the numbers in the table tell the story well when I use them.

A third option is using the mean ranks that SPSS gives me in the output of the Mann-Whitney. The mean ranks are what are being compared between groups, so perhaps I should just use those? Only problem I have with this is that the mean ranks don't really mean anything in regards to the actual data (e.g. I can't see that subjects are closer to a 3 while controls are closer to a 1 using mean ranks.)

And a last option was performing a chi-square analysis comparing subjects and controls after splitting the scores into two groups (0 and 1 for low and 2 and 3 for high). However, when I did this, the differences weren't as pronounced (probably for a number of reasons).

$\endgroup$
  • $\begingroup$ Are you asking about how best to present your data in text, in a table, or in a figure? $\endgroup$ – gung - Reinstate Monica Feb 4 '15 at 19:35
  • $\begingroup$ Both text and table. In the text I'm going to say there were significant differences between groups on several components of my sleep survey. Those differences are via a Mann-Whitney test, so they are comparing mean ranks. What I don't know is how I should present these differences in a table. Using medians doesn't work because they are far too similar and you can't see the differences. Means work better, but it seems strange to use parametric measures in a table which should be about the non-parametric medians. And mean ranks would work, but they don't represent actual values. $\endgroup$ – Eric Feb 4 '15 at 19:40
  • 1
    $\begingroup$ I wonder whether some answers from Graph for relationship between two ordinal variables could be adapted for your purposes? The example graphs show the relationship between two variables each with five levels, but if you are e.g. comparing two groups and you have four possible levels, you could re-imagine some of those visualizations as 4-by-2 instead of 5-by-5, perhaps. $\endgroup$ – Silverfish Feb 4 '15 at 21:26
  • $\begingroup$ It might be helpful if you could post some (possibly entirely bogus) example data, so that people who want to demonstrate a possible technique have something to work with. $\endgroup$ – Silverfish Feb 4 '15 at 21:27
  • 1
    $\begingroup$ Eric, by definition a nonparametric test, Mann-Whitney in particular, compares (for the dominance) two distributions generally, it does not compare a specific parameter value of a distribution, such as mean or median. There exist no single number which is a characteristic of a distribution and at the same time is what is being compared, in this case. You may use Hodges-Lehmann 2-sample estimator, but it is the characteristic of the difference between two distribution and not of each of the two distributions. $\endgroup$ – ttnphns Feb 5 '15 at 6:49
8
$\begingroup$

This is an excellent question. As you found, quantiles do not work when there are many ties in the data, because they are too discontinuous as estimators. I often find means work best, if you can assume that the spacing between the categories are at least "halfway meaningful." Exceedance probabilities are always valid. In your case these would be estimated by the proportion of observations $\geq 1, \geq 2, =3$. Mean ranks are useful when comparing groups, but I don't see as much use for a single variable.

The correctness of using the mean to summarize ordinal variables can seldom come from the data themselves. It is subjective.

Instead of using mean ranks I would use an appropriate rank correlation measure or the concordance probability (a simple linear translation of the Wilcoxon-Mann-Whitney statistic; it is the mean rank of observations in one of the two groups divided by a constant) between two variables (e.g., a binary grouping and an ordinal scale). Choices for correlation coefficients include Somers' $D_{xy}$ (which is consistent with the concordance probability and penalizes for ties on the ordinal variable) and Goodman-Kruskal $\gamma$ which doesn't penalize for ties on either $x$ or $y$.

$\endgroup$
  • 1
    $\begingroup$ Hi Frank, thanks for your thoughtful response. If you don't mind, I have a couple follow-up questions. Regarding the means - I believe the categories are at least halfway meaningful, as they basically refer to "no, mild, moderate, and severe impairment," respectively. Are there any references you know of that I might be able to use as precedent for this? I'm also hesitant to use means in only one table, and medians in others for consistency's sake. AND for mean ranks - I believe I am comparing groups - subjects vs. controls on 7 scores. Is comparing mean ranks acceptable/useful? $\endgroup$ – Eric Feb 4 '15 at 19:19
  • $\begingroup$ For numeric ordinal data with few levels, such as counts and perhaps your impairment example, means are useful and medians are not (because of too many ties). There are many occasions when I've used means for ordinal data and medians for skewed continuous ones, in the same table. $\endgroup$ – Frank Harrell Feb 26 '16 at 12:21

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.