# How to compare sampled areas to the Census?

I would like to discriminate sampled areas that are representative or not representative of their corresponding population, for a given characteristic.

Suppose I have surveyed areas (i.e. Census tracts) within a given population area (i.e. county). I want to compare characteristics of my sample (i.e. number of males within an area, number of Hispanics, etc.) to values provided by the Census.

My data is as such:

 TractID | SamplePop | TractPop | SampleNMale | TractNMale
-----------------------------------------------------------
00001 |      719  |    1317  |        257  |       441


where I have counts for characteristics that correspond to my sample and the Census tract. I am interested in seeing which sampled tracts are representative of their corresponding population.

If I aggregate my data to the study population area (i.e. Census) then it is easy to see that I could use a chi-square test for each of the characteristics I'm interested in.

For example, I could construct a $2$ by $2$ table for gender and perform a chi-square test:

      | Sample | County
--------------------------
Male  | 56,511 | 951,166
Female| 56,247 | 762,462


and it is easy to see that my sample is significantly different from the Census for gender ($\chi^2=1242.03, df=1, p<. 0001$).

However, my study population area has natural subdivisions (i.e. Census tracts) and I know that there may be some areas (i.e. Census tracts) within my study area (i.e. county) that are representative of the population. In other words, I might have sampled some Census tracts very poorly and sampled other Census tracts just fine.

I could produce a $2$ by $2$ for each Census tract and calculate their respective chi-square values. For example within Census tract $k$ I have

      | Sample | Tract
------------------------
Male  |    257 |   441
Female|    462 |   876


and it is easy to see the results for the given tract are not significantly different than expected from the Census ($\chi^2 = 0.9555, df=1, p=0.3283$). For something like gender I could do a Mantel-Haenszel test, but not for other characteristics such as race/ethnicity.

I would like to discriminate sampled areas that are representative or not representative of their corresponding population for a given characteristic. I want to be able to plot these on a map with quartiles or meaningful ranges to signify areas that are better/worse representations of their population and examine their spatial distribution.

Current ideas:

• Difference between %s (i.e. for a given tract, 60% sampled are male compared to 51% in the Census)
• Chi-square tests

Edit:

These data correspond to geographic regions within the United States. The Census Bureau publishes aggregated data for geographic regions of different scales (e.g. states, counties, tracts, block groups, and blocks, etc.). Therefore studies that sample within a standard area have reliable data about population demographic characteristics.

I would like to understand how well my sample reflects the demographics of the population of the study area. Since population demographic data is available at difference scales, I would also like to identify sub-areas within the study area that are representative of their corresponding population, and sub-areas that are not representative of their population. This will help me to understand limitations to my study enrollment and identify both locations, and characteristics of those locations, that need to be targeted for future recruitment to obtain a representative sample.

How can I determine whether my sample within a given area is representative of their corresponding population?

• Please say which country you are referring to. This is an international forum, and no country is the default. Even if the country concerned is irrelevant to good answers, giving the information would do no harm. A quite different (and indeed contentious) issue is what meaning you attach to significance tests here, when what you have is the population in any sense, and errors do exist but they are measurement errors. (I know much, much more could be said about this, but what you intend to get out of significance tests is unclear.) – Nick Cox Dec 20 '13 at 14:02
• @NickCox I tried to address your questions. Does my edit make things more clear? – Ellis Valentiner Dec 20 '13 at 16:48
• One that will greatly help this is knowing the sample design - how you collected your data. This can have a big impact - especially if the response variables are about opinions and preferences. – probabilityislogic Dec 21 '13 at 12:28
• Have you considered using the IPUMS instead of aggregated data? – shadowtalker Dec 23 '13 at 23:37
• @ssdecontrol I'm not familiar with IPUMS but it looks very interesting. Thank you. – Ellis Valentiner Dec 25 '13 at 1:03