How do I normalize a set of data? Let's say we are looking at measurements of diameter of the heart in women and men. Men will have bigger hearts, so error in measuring by the observers will always be bigger. Is there a way to normalize heart size so that I will be able to compare inter-observer variability in measuring this size?
I have, lets say, 5 hearts of different size and 75 observers. Each 15 observer measure the length by ultrasound of one heart and I want to compare their performance. Which observer is best (against gold standard—i.e., the one that has the smallest error), but the one with the smallest heart, can have smaller error against the one who had the biggest heart to measure - but even if the error was let's say bigger by 4mm, the heart was 1.5 times bigger, so he performed better.