I would like to discriminate sampled areas that are representative or not representative of their corresponding population, for a given characteristic.
Suppose I have surveyed areas (i.e. Census tracts) within a given population area (i.e. county). I want to compare characteristics of my sample (i.e. number of males within an area, number of Hispanics, etc.) to values provided by the Census.
My data is as such:
TractID | SamplePop | TractPop | SampleNMale | TractNMale
-----------------------------------------------------------
00001 | 719 | 1317 | 257 | 441
where I have counts for characteristics that correspond to my sample and the Census tract. I am interested in seeing which sampled tracts are representative of their corresponding population.
If I aggregate my data to the study population area (i.e. Census) then it is easy to see that I could use a chi-square test for each of the characteristics I'm interested in.
For example, I could construct a $2$ by $2$ table for gender and perform a chi-square test:
| Sample | County
--------------------------
Male | 56,511 | 951,166
Female| 56,247 | 762,462
and it is easy to see that my sample is significantly different from the Census for gender ($\chi^2=1242.03, df=1, p<. 0001$).
However, my study population area has natural subdivisions (i.e. Census tracts) and I know that there may be some areas (i.e. Census tracts) within my study area (i.e. county) that are representative of the population. In other words, I might have sampled some Census tracts very poorly and sampled other Census tracts just fine.
I could produce a $2$ by $2$ for each Census tract and calculate their respective chi-square values. For example within Census tract $k$ I have
| Sample | Tract
------------------------
Male | 257 | 441
Female| 462 | 876
and it is easy to see the results for the given tract are not significantly different than expected from the Census ($\chi^2 = 0.9555, df=1, p=0.3283$). For something like gender I could do a Mantel-Haenszel test, but not for other characteristics such as race/ethnicity.
I would like to discriminate sampled areas that are representative or not representative of their corresponding population for a given characteristic. I want to be able to plot these on a map with quartiles or meaningful ranges to signify areas that are better/worse representations of their population and examine their spatial distribution.
Current ideas:
- Difference between %s (i.e. for a given tract, 60% sampled are male compared to 51% in the Census)
- Chi-square tests
Edit:
These data correspond to geographic regions within the United States. The Census Bureau publishes aggregated data for geographic regions of different scales (e.g. states, counties, tracts, block groups, and blocks, etc.). Therefore studies that sample within a standard area have reliable data about population demographic characteristics.
I would like to understand how well my sample reflects the demographics of the population of the study area. Since population demographic data is available at difference scales, I would also like to identify sub-areas within the study area that are representative of their corresponding population, and sub-areas that are not representative of their population. This will help me to understand limitations to my study enrollment and identify both locations, and characteristics of those locations, that need to be targeted for future recruitment to obtain a representative sample.
How can I determine whether my sample within a given area is representative of their corresponding population?