Method to test whether a small number of perfect correlations can be trusted within a large sample There are two binary vectors with 0s or 1s as values and the correlation between them is calculated; this is done for 20,000 pairs of vectors. Theoretically, is there a difference between having only 3 of these 20,000 correlations having perfect correlation vs. 15,000 of these 20,000 having perfect correlation? Can the perfect correlations in either of these scenarios be trusted more?
Is there a numerical method to actually test whether or not these perfect correlations are meaningful or trustworthy? For instance, after a certain sample size, could having only a couple perfect correlations out of thousands or millions of correlations be caused solely by chance?
Edit for more context:
I'm interested in comparing two binary vectors for utility meters (for instance, 0 = the meter is on, 1 = the meter is off). The correlations between these vectors are being used to see if these meters are most likely on the same transformers or not. So if we have 20,000 correlations between different meters and only 3 of them are perfect or high (0.9-1.0) correlations, can that be trusted versus maybe 15,000 of them being perfect or high correlations? And is there a numerical method in order to test if these perfect correlations are legitimate?
 A: It is a little beyond what statistics can do to tell you if an observation is "legitimate" or "can be trusted", because that's a very context-specific matter. Among the things it can do that are sort of like that is quantify how far an observation is from the rest of the data; that is, how much of an outlier it is. All other things being equal, a data point that's more of an outlier is more likely to represent bad data of some kind (anything from a number being written down incorrectly, to a rich person ending up in a sample that you wanted to include only poor people). If you want to look for outliers, the first thing to do is plot your data. (Actually, the first thing to do in pretty much any data-analysis problem is plot your data.)
However, I don't think quantifying outliers is necessarily a good way, on its own, to answer your question about whether different meters are on the same transformer. For that, you presumably want a sample of distinct pairs of meters that you know aren't on the same transformer, and a separate sample of distinct pairs of meters that are. Then you can use the data from these known pairs to classify the unknown pairs in your original data.
