1
$\begingroup$

This post is a continuation of my previous post.

After reading all comments and answer, I think that F-statistics tells us whether explanatory variables in a model is significant or not, as the null hypothesis in F-test is that the variables have no predictive power.

As model 2 has unusually high F-statistics compared to model 1, am I right to say that model 2 is kind of 'weird'?

Also, what does more negative F-statistic imply? Does it have smaller or larger p-value?

$\endgroup$

1 Answer 1

4
$\begingroup$

the null hypothesis in F-test is that the variables have no predictive power

This is an incorrect understanding. The null hypothesis for an F test of nested models is that the encompassing model does not explain more variance than the smaller encompassed model, except for fitting noise. The F test is not about predictive power at all.

F statistics are hard to interpret without knowing the degrees of freedom. Given that your table notes "coefficients", it appears like all your predictors are numerical, rather than, say, categorical. In this case, one can say that the larger F value for model 2 than for model 1 indicates that the improvement that model 2 offers over the intercept-only model is larger than the improvement that model 1 offers over the intercept-only model - in both cases, in terms of variance explained. One can hope (hope!) that this means that model 2 will yield better predictions, but this is not at all clear-cut.

$\endgroup$
3
  • $\begingroup$ It seems that from my lecturer's note, degree of freedom is the number of explanatory variables (exclude constant). $\endgroup$
    – Idonknow
    Commented Sep 11, 2019 at 0:22
  • $\begingroup$ An F distribution has two degrees of freedom (numerator d.f. and denominator d.f.) $\endgroup$
    – Glen_b
    Commented Sep 11, 2019 at 2:44
  • $\begingroup$ My bad. I forgot to include another df: number of explanatory variables and 100 - number of explanatory variable - 1 (for constant term). $\endgroup$
    – Idonknow
    Commented Sep 11, 2019 at 5:59

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.