2
$\begingroup$

I'm trying to understand the definition of Partial R-squared values in the context of a regression model. Does anyone have a layman's definition or an intuitive example that might help me better understand what it means?

Thank You!

$\endgroup$

2 Answers 2

4
$\begingroup$

Let's look at the equation.

$$ R^2_{partial} = \dfrac{SSE(reduced) - SSE(full)}{SSE(reduced)} $$

In words, this compares the reduction in SSE from the reduced to the full model to the SSE of the reduced model. (We know the full model will have lower SSE.)

When the reduced model is the intercept-only model, the reduced model always predicts $\bar{y}$. This means that $SSE(reduced) = SSTotal$. Thus...

$$ R^2_{partial} = \dfrac{SSTotal - SSE(full)}{SSTotal} $$

This is the usual $R^2!$

Therefore, much as $R^2$ describes the variance (proportional to $SSE$) of a model, compared to the variance of the intercept-only model (naïvely guessing $\bar{y}$, no matter the predictor values), partial $R^2$ describes the variance explained by a model, compared to a more complex model than the intercept-only model.

$\endgroup$
1
  • $\begingroup$ Thank you for your explanation! This is very helpful and illuminating. $\endgroup$ Commented Jun 29, 2021 at 7:28
1
$\begingroup$

See this answer by amoeba.

This site and this site make it clear that the partial R-squared (also known as the coefficient of partial determination) can be used to assess the goodness of fit of a reduced multiple linear regression model as compared to a full(er) model.

The partial R-squared gives the proportion of variation explained by the explanatory variables in the full(er) model that cannot be explained by the explanatory variables in the reduced model. If the reduced model is a good fit compared to the full(er) model, then it will have a low partial R-squared.

EDIT: Please note that I just learned about this topic to answer this question because I had never heard of it before.

$\endgroup$
2
  • $\begingroup$ This is consistent with how $R^2$ compares your model fit to the naïve model that always predicts $\bar{y}$ (intercept-only model). $\endgroup$
    – Dave
    Commented Jun 16, 2021 at 19:24
  • $\begingroup$ Thank you so much for your explaination! It is very good, especially considering you just learned it! Thank You! $\endgroup$ Commented Jun 29, 2021 at 7:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.