4
$\begingroup$

I have results from 5 surveys each 2 years apart and let us assume that no subjects are selected in more than one survey.

The sampling method used in these surveys are biased and I have sampling weights calculated(with respect to the population) for each data point in each study.

The question is, how would I be able to combine the 5 datasets and have the weights recalculated so as to obtain one giant dataset for analysis on this population?

Also, what should I do if subjects appear in more than one survey?

Updates/Further Elaboration:

thank you @user30523, here are some more infomation that might be useful:

Suppose I wish to find out the estimated distribution of height across the population using these 5 datasets.

In some data, younger people are oversampled because of the location where the survey are conducted. Let's assume the weights are calculated with respect to their age.

Eg. assuming 2% of the population are 15 years old, and the location of the survey is at a mall where 15-year-olds made up 5% of all shoppers, then sampling weight for an subject aged 15 in that survey would be calculated as 0.02 / 0.05 = 0.4. For simplicity, each person in the mall has equal chance of being surveyed and all participants complied when asked.

Given that 5 surveys are conducted in 5 different malls and each has their set of weights calculated in the same way, how would I then be able to combine all 5 datasets and recalculate the sampling weights?

P.S: I'm new to the topic on sampling weights so do correct me if I have made errors in the way I have calculated the weights.

$\endgroup$
  • $\begingroup$ You mentioned each survey was already weighted. Are they weighted using similar methods? Or, did the particulars of the surveys necessitate using different weighting methods? $\endgroup$ – Jonathan Oct 8 '13 at 1:20
  • $\begingroup$ hi @Jonathan, sampling method is the same as mentioned in the example, but of course the values of the calculated weights, sample size, and subject particulars are different for the 5 surveys $\endgroup$ – stats_newb Oct 8 '13 at 1:51
2
$\begingroup$

I think if each dataset is already weighted to your satisfaction, then you have a couple of different options. Which one is the right one may vary based on your objectives and the particulars of your existing data collection and weighting.

  • (#1) Union all of the datasets, along with their pre-calculated weights, and that's it.

This would be the right choice if each dataset was weighted towards a proper total count and didn't over-state the importance of any individual record relative to another dataset. If one dataset was weighted to reflect Total US Population, and another dataset was weighted in place to its own total count of respondents, then this would not be the right choice.

  • (#2) Calculate a weight for each dataset to multiply by each record's existing weight

This would be the right choice if each of your datasets are of equal importance regardless of their size. Example below...

  • (#3) Union all of the raw data and re-calculate the weights on the new, entire dataset

This would be the right choice if the reasons for non-response are similar across your different surveys - it results in the simplest data for you to work with, and it's the least likely to produce extreme weights.

Example for #2: each dataset is weighted to equal importance, with this "dataset weight" being multiplied by whatever weight has already been calculated within the dataset.

> Survey 1: 100 people   weight:  2
> Survey 2: 200 people   weight:  1
> Survey 3: 300 people   weight:  2/3
> Survey 4: 150 people   weight:  4/3
> Survey 5: 250 people   weight:  4/5
$\endgroup$
  • $\begingroup$ Thanks @Jonathan, this is what I wished to know. Just a final question before I accept this as answer: if in 4 surveys the weights were summed to total respondents, and 1 survey was weighted to reflect Total US population. If I multiply (Respondent size/Total US pop) to the weights of that 1 survey, and union the 5 datasets together with their weights. Would it be right to say that I have achieved final weights where each individual record do not have any special importance relative to another dataset? $\endgroup$ – stats_newb Oct 16 '13 at 1:48
  • 1
    $\begingroup$ I think that would be appropriate - you would be essentially adjusting your weighting scheme so you fall into situation #1. $\endgroup$ – Jonathan Oct 17 '13 at 1:12
0
$\begingroup$

It is hard to answer your question without sample data or how you calculated weights.

Trying to decipher your question, it seems like the easiest thing to do would be to join the data sets using the join command from the plyr package in R.

Once you have one large dataset, you can recalculate weights.

As far as if the subjects appear in more than one survey, it depends on what analysis you are doing, the sampling plan, and how many subjects repeat. I need more info before I can make a suggestion on what to do.

$\endgroup$
  • $\begingroup$ thank you @user30523 for your reply, I have added more information above! $\endgroup$ – stats_newb Oct 7 '13 at 7:10

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.