If we have data with multiple measurements per subject, I understand we must model or correct for the non-independence. I believe there are several approaches to doing this. One is a mixed effect model using subject ID as a random effect. Another models subject ID as a fixed effect (i.e. the "fixed effects model" in panel data terminology). Another involves fitting a regression model ignoring the clustering (i.e. a working independance model with no variable for ID), but correcting the standard errors after fitting the model, i.e., computing cluster robust standard errors. Although the latter approach corrects the standard errors, it does not correct the point estimates, i.e., estimated parameters. Therefore I cannot understand how this is a valid approach for estimating paramaters if, for example, some subjects appear more times than others in a dataset.
Supposing one subject with particularly high values of the response variable (Y) for a given predictor, appeared substantially more times in the dataset. Would this not cause the corresponding parameter estimate to be biased high? In the fixed or random effects model (explicitly modelling subject ID), I don't think this occurs since each subject has its intercept based on its average of Y (I think, though I might be missing some technical details). I'm aware that clustered standard errors can also be used after a fixed or random effects model.
If we have multiple measurments per subject, when is ONLY using the cluster standard errors approach valid i.e. NO fixed or random effect variable for subject ID, but correcting the SE's for clustering after model fitting? I am particularly concerned about bias in parameter estimates and any possible differences in approach w.r.t the type of regression model e.g. ols, Poisson, logistic, Cox etc.
Perhaps we assume that, on average, the parameter estimate for Y will be unbiased since the subjects sampled more than once will (in the long run) balance out in terms of "low" and "high" Y values. I'm not sure if there is a way to "check" this after model fitting with the usual diagnostic plots?