Test if sampled data are randomly sampled Is there a way to test if data are (or at least seem) randomly sampled?
In other words, is there a way to measure if my data are randomly sampled -- instead of coming from a complex survey sampling for example -- to a statistically significant level?
I imagine something like comparing means over repeated sub-sampling.
Or is this impossible? If so, why?
 A: The process of taking a simple random sample means that every possible sample has an equal probability of being the sample taken. This means that any sample that could have come from a more complex sampling scheme (stratified, cluster, etc.) could also have come from a simple random sample.  So there is no definitive way to prove one way or another.
However, you could come up with a prior on how likely different types of sampling are, then do a Bayesian analysis to find the posterior probability of a simple random sample vs. the other types.
A: If the data was gathered in a methodologically sound way and samples are big enough then both samples could reflect the population. Generally, it appears that you want to see if the data reflects the population well enough (or stating it differently: if one of the samples is not biased). The best way to do this is to compare those samples to the population - are the properties of the sample similar to those in the population..?
Another thing is "randomness" of a sample. First of all, there is no such a thing as a "random" survey sample - it is never possible to sample literally any person in the population with the same probability. You always make decisions on how would you sample individuals to your research. If you use telephone interviews then you don't sample individuals without phones, if you go door by door, then you sample mostly the unemployed or housewives etc. (check How to Lie With Statistics book for more examples). So what you should do is to take into consideration how and why your sample is biased and does it influence possible results and describe it in methodological part of your report. The general question should be here: "how much the sample possibly differs from the population?", rather then "how much it looks like it's randomly sampled?". There is nothing bad in non-random samples as far as you remember that they are not random and do not threat them as random.
Generally there are tests for randomness, however I don't feel that this is what you are looking for. Notice that, if this is a survey data, then people are not similar to "white noise" in any fashion, so there is no point in checking if the data is purely random.
