1
$\begingroup$

Very often in regression models, the assumption of homoscedascity is violated. I am wondering how is it possible that no one as of yet (as far as I could find in the literature) developed a parameterized heteroscedastic normal distribution?

So far, to assess heteroscedascity, researchers calculate the residuals of the model and then plot their variance across the predicted values of the outcome.

However, this seems like a "post-hoc" approach and it would be nicer if the heteroscedascity was already incorporated as a parameter in the parameterization of the distribution itself.

I would like to ask for reasons why this doesn't currently exist - was it tried, but attempts were unsuccessful? Is it impossible to model the heteroscedascity like this? Or is there another reason why this doesn't exist?

$\endgroup$
3
  • $\begingroup$ What, exactly, assumes equal variance? I can fit an OLS linear regression with unequal error variance with zero trouble: just calculate $\hat\beta_{ols}=(X^TX)^{-1}X^Ty$, as usual. $\endgroup$
    – Dave
    Commented Jun 7, 2023 at 4:06
  • $\begingroup$ we would just use multivariate normal distributions with a particular covariance structure $\endgroup$ Commented Jun 7, 2023 at 4:15
  • 1
    $\begingroup$ Is this generalised least squares? $\endgroup$
    – Alex J
    Commented Jun 7, 2023 at 4:24

1 Answer 1

3
$\begingroup$

In statistics, a sequence (or a vector) of random variables is homoscedastic (/ˌhoʊmoʊskəˈdæstɪk/) if all its random variables have the same finite variance; this is also known as homogeneity of variance. The complementary notion is called heteroscedasticity, also known as heterogeneity of variance.

https://en.wikipedia.org/wiki/Homoscedasticity_and_heteroscedasticity

Homoscedastic errors mean that we are talking about random variables that have the same distributions. Heteroscedasticity means that they have different distributions. You cannot have distribution parametrized in a way that it can be different from itself.

There are though regression models that allow for heteroscedastic errors. Check for example the Generalized Least Squares or R’s nlme library that allows for fitting mixed-effects models with custom error variance functions.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.