# Quantifying agreement between datasets from different methods of measurement

I have two datasets, A and B. Both ultimately come from the same source, both have the same data attributes, but the datasets use different measurement methods to derive the attributes. We want to know that both A and B are not only correlated but in agreement.

How do I compare the results of A to B in such a way that shows that the results of data B agree with, but may be more accurate than data A?

Example:

A data result

+----------+----------+----------+
| Location | MeasureA | MeasureB |
+----------+----------+----------+
| 1        | 34.56    | 234.6    |
| 2        | 123.0    | 56.78    |
| .        | .        | .        |
| .        | .        | .        |
| 256      | 68       | 453.12   |
+----------+----------+----------+


B data result

+----------+----------+----------+
| Location | MeasureA | MeasureB |
+----------+----------+----------+
| 1        | 35.1     | 234.4    |
| 2        | 122.7    | 56.7     |
| .        | .        | .        |
| .        | .        | .        |
| 256      | 68.3     | 453.14   |
+----------+----------+----------+


The main goal is to be able to define data pipeline regressions across differing methods without the results being exactly equivalent.

• I am not sure if I understood exactly the question. To see the the agreement between the two versions, could you not use something such as Spearman rank Correlation? If you are interested in the distribution of the measures, maybe you could use a qq-plot? Commented Feb 14, 2020 at 13:11
• It is not clear what you are asking. You want to show "that the results of data version2 agree with, but are more accurate than data version1". Agree with what? Commented Feb 14, 2020 at 18:45
• @DanielTheRocketMan the Spearman correlation is exactly the direction I was looking for. What is a way I can rephrase the question so that it is more understandable and useful for others?
– Wes
Commented Feb 17, 2020 at 17:17
• Maybe you can just change the question to "Comparing the ranking of multidimensional datasets from different code versions" Commented Feb 18, 2020 at 0:51