I would like to measure the divergence (or, more appropriately, symmetric difference) between two distributions $P$ and $D$. In general, you could consider using a measure like Jensen-Shannon divergence (JSD). However, consider the case in which we are attempting to judge our predictions of the distribution of scores for an olympic diver. If the scores are out of 5, and the true distribution is $[0, 0, 0, 1.0, 0]$, then a guess of $[0, 0, 0, 0, 1.0]$ is much better than a guess of $[1.0, 0, 0, 0, 0]$. However, to a measure like JSD or Kullback–Leibler, these guesses are equally bad, since the distribution is assumed to be over categorical outcomes as affirmed here.
Are there any accepted ways of comparing these distributions given the assumption that the distribution is over items that can be considered to have an ordering? Simply smoothing the predictions would have this effect to some degree, but that would require adding more parameters (i.e., smoothing strength) and I'm not sure how valid it would be.