# Stratified sampling with multiple variables?

I don't know much about stats so I'm looking for a starting point here. Any resources or insights would be helpful.

I'm conducting an e-learning experiment, in which students watch videos and then complete a survey which measures cognitive load and user satisfaction, and afterwards they complete a short assessment to test what they have learned.

Because of the issues with pre-testing in learning, I want to stratify the experiment groups by three vairables:

1. Results of a previous examination
2. Attitude towards their course (measured by survey)
3. Attitude towards e-learning (measured by survey)

By doing this I can minimise variance between each group.

If I was stratifying by variable 1, I could ensure that each group had an equal amount of 'A' students, 'B' students etc.

However, I'm not sure how to fairly divide students into groups given that I have three variables to control for. I could just play around with the groups until I get them roughly even, but I was wondering if there are statistical methods for stratifying with multiple variables?

Thanks.

• Hi there, how many categories do you have for each of your 3 stratification variables? There are options other than complete counterbalancing although they have cons. Having more information on the category sizes would be useful. Also, how many subjects do you think you can get? Feb 12, 2012 at 4:43
• Is the survey mentioned in variables 2 and 3 a different survey from the one you want to stratify for? You can't stratify on the basis of a variable unless you know its distribution for the whole population, not just your sample. Feb 12, 2012 at 5:34
• Even if you could stratify, I think you have too many strata for your number of subjects. You would be better using those variables as predictors in some type of GLM, e.g. regression. Feb 12, 2012 at 19:36
• I agree with Michelle. With only 60 subjects one stratum sounds about right (and you have the advantage, presumably, of knowing the grades of everyone in the population!), and I wouldn't try to weight based on the other survey results so much as use model based estimation to improve your total estimates. Feb 12, 2012 at 19:53
• After, although the more thinking you've done before the experiment the more likely you are to gather the right data. While the analysis is after the fact, you obviously can't do it if you find you've neglected to collect some crucial bit of info. Feb 12, 2012 at 23:12

I've found Thomas Lumley's survey package for R relatively straightforward to use and it has the advantage of being free. I would say this or something equivalent is essential for decent survey analysis. It has a good website and an even better book - you probably need to get hold of the book or an equivalent for all this to make sense