I have a series of binary opinion questions asked of a random selection of people visiting a website. e.g. "Do you support the Death penalty" etc. I also have a number of demographic binary classifiers of the respondents (male/female)(wealth/not wealthy)(liberal/conservative)(college educated/not college educated)(religious/not religious) etc.
What I am interested in is identifying the characteristics that may matter in terms of understanding which classifiers should be considered when predicting the opinions of the people in certain subgroups. That is, for example, if the entire sample is split 30% for/70% against the Death Penalty, but the liberals are 10/90 and conservatives are 40/60, are these classifiers statistically meaningful? or in laymans terms, is political orientation a meaningful input to people opinion about the death penalty.
So my question is, should I measure each classification in my 2x2 table constructed to evaluate Fishers Exact be against the overall mean of the group as a whole, or rather look at the difference in rates between people on each side of the classifier? That is, men v women, as opposed to men v entire population and women v entire population.
Many thanks.