0
$\begingroup$

I have a dataset which is a combination of some survey results and some demographics. All survey results are normalized by population density. Now I want to design a model to see the relationship between some of the variables. The model looks like this:

lm(log(violation+1) ~ Wighted.mean + mks + In_ct + Asian + Black + Hispanic + PopDen + MedHouseIncome, data = dt, weights = pop)

How can I decide if weights is useful here? When I remove it I get different coefficients with less R-square. But I feel like that is not enough to decide. Can anyone give me suggestions of how to decide that?

$\endgroup$
0

1 Answer 1

2
$\begingroup$

At the very high level:

If you have weights from a survey data set they might be doing quite a few things, the most straightforward of which is allowing you to offset the survey's sampling scheme. For example if women were over-sampled relative to men then the weights would reflect this and analyses that used them would be correct for the actual population's gender balance rather than the one in the data. In your case, they might be offsetting the standardization too.

In short, weights change your estimand (the quantity your estimation strategy is targeting). So if you care about the quantities your survey thinks you ought to care about, e.g. to be 'representative' to a particular population, then you'd want to use its weights.

But things are, inevitably, more complicated than that, as weights can offset other features and perhaps less necessary when your model's covariates include the one used to unbalance the sample, or when you want particular conditional effects.

The best advice is to take a look at the survey's variable codebook and see what it thinks the weights will do for you. (There may indeed be different weights for different purposes). Then make your decisions on that basis. Certainly not on whether the model summaries look different with and without them.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.