2
$\begingroup$

I am running a regression where I am trying to identify the influence of the proximity to Tuskegee, Macon County and the percentage of the African-American population on the COVID-19 vaccination rate on county level.

reg vaccination_perc_points c.dist_Tuskegee##c.perc_points_afri_am i.urban_rual i.education_low_high median_income perc_points_male social_capital_index perc_points_am_indian_alaka_native perc_points_asian, robust

Now I would like to apply state-level effects. I am wondering whether I should apply random or fixed effects. I control for all possible realizations of states, which would indicate fixed effects. But I am only interested in a fraction of my population (African-American) which favors, as far as I understood, random effects.

$\endgroup$
2
  • 2
    $\begingroup$ I would have thought random. Otherwise you are estimating 50 parameters in which you have no interest. $\endgroup$
    – mdewey
    Commented Nov 27, 2021 at 13:42
  • $\begingroup$ One suggestion from the literature is to choose random effects based on dispersion, high variances suggest random effects. $\endgroup$
    – user78229
    Commented Feb 13 at 1:25

3 Answers 3

2
$\begingroup$

Random effects are best used when you are trying to summarize a lot of variation between groups, people, or any other cluster of data (see lengthier discussion here). In this case, 50 clusters (states) is a lot of groups to consider, and is not likely your primary theoretical fixed effect of interest. Nonetheless, I believe your assessment is correct that the states can be used as random effects.

If you are specifically curious about how each state varies but don't want to enter them as fixed effects, you can use caterpillar plots (shown in the previously linked answer) to show how much each state varies by 1) average increase/decrease in the dependent variable or 2) variation in slopes.

$\endgroup$
1
$\begingroup$

Individual attributes are usually modeled as random effects.

Random effects involve pooling from other categories, assuming the samples from each category come from the same higher level population and are somewhat similar. It works well even when each category has small samples, cause it uses data in other categories as well.

See: What is the difference between fixed effect, random effect and mixed effect models?

$\endgroup$
1
  • $\begingroup$ Individual attributes are usually modeled as random effects.---This is too specific to subject-level research and can probably be lumped into just cluster-level effects, which you hint at with your second paragraph. $\endgroup$ Commented Feb 13 at 1:11
-1
$\begingroup$

Random effects plus a geographic control (e.g. a Gaussian process).

The answer to “fixed or random effects” is pretty much “always use random effects.” If you have more than 2 variables, fixed effects are inadmissible, i.e. always worse (by Stein’s estimator).

There’s really no good reason to use fixed effects when you have the option of random effects, unless your goal is to save effort or computation.

$\endgroup$
6
  • 1
    $\begingroup$ There’s really no good reason to use fixed effects for anything, except to save effort. I don't understand this comment. Can you elaborate? Why would anybody use regression if fixed effects are never useful? $\endgroup$ Commented Feb 13 at 1:09
  • $\begingroup$ @ShawnHemelstrand Random effects regression is a kind of regression. $\endgroup$ Commented Feb 17 at 4:53
  • $\begingroup$ My point isn't that fixed effects are never useful--they're definitely an improvement on no effects! But Stein's phenomenon shows that the random effects estimator will always have a smaller mean squared error than the fixed effects estimator. $\endgroup$ Commented Feb 17 at 4:57
  • $\begingroup$ The mean squared error shouldn't be the only criterion for selecting fixed and random effects. If MSE was the only reason to run models, then overfitting regressions would be the norm in statistics. $\endgroup$ Commented Feb 17 at 5:38
  • $\begingroup$ @ShawnHemelstrand I mean out of sample MSE, or MSE of regression coefficients, not MSE of in-sample predictions. I suggest googling “Stein’s estimator.” $\endgroup$ Commented Feb 20 at 7:00

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.