# How to evaluate a curve considering outliers?

I have data on runners who run marathons; for each runner I have their final times on a number of races. I would like to predict how fast they are running considering outliers i.e.

• he's running faster than x hours with probability:

x | P(x)

1:30 | 0%

2:00 | 1%

2:30 | 30%

3:00 | 66%

4:00 | 3%

So, I have a curve for each athlete for the probability he's running the marathon in x hours.

How can I evaluate the curve?

Background: Currently I'm doing my evaluation using RMSE i.e. I guess that he will run in 2:45h and evaluate the error.

This doesn't make much sense for me, since in reality he's running usually in 2:30 hours but he has some outliers which influences the mean downwards to 2:45 hours.

I would like to evaluate my curve, which encodes that I have downwards outlier with certain probabilities.

• I did some pretty extensive editing to fix the grammar of your post; I hope I did not mess up the meaning. – Peter Flom Dec 2 '12 at 14:22
• It sounds like you're asking for individual distribution functions of the predicted times, discretized to half-hour intervals. Did I understand right? If so you'd need some kind of model that reduced the potential differences in two CDFs down to some finite set of things that relate to the differences in distribution, such as (for example) assuming shifts in scale or location and scale exist (and maybe depend on a few parameters) but the shapes are similar. – Glen_b Dec 2 '12 at 15:38
• Actually, it should not be discretized, it should be continuous. – user1141785 Dec 3 '12 at 9:37
• The idea with the shifted/scaled CDFs is exactly what I need. But how can I evaluate that my CDFs are scaled/located correctly and that my predictions are correct? – user1141785 Dec 3 '12 at 9:54
• Your statements seem contradictory to me. On the one hand, you say "This doesn't make much sense for me, since in reality he's running usually in 2:30 hours but he has some outliers which influences the mean downwards to 2:45 hours." And at the same time you say "I would like to predict how fast they are running considering outliers". Do you want the outliers to be considered or not? Or maybe weighted down? Please clarify. – user765195 Jan 1 '13 at 16:32