Questions tagged [f-statistic]

An F statistic is a value you get when you run an ANOVA test or a regression analysis to find out if the means between two populations are significantly different.

Filter by
Sorted by
Tagged with
0 votes
0 answers
46 views

F-Statistic and F-distribution [duplicate]

I am reading ISLP chapter 3.2 about multiple linear regressions. F-statistic seems like to be a statistic calculated per sample. But also we know that it is just and estimation for the stat on whole ...
amineh's user avatar
  • 45
2 votes
1 answer
27 views

Interpreting linear regression (Do grammar schools increase the attainment gap for disadvantaged pupils?)

On Monday The Education Policy Institute published its annual report on education in England https://epi.org.uk/annual-report-2023/. This focusses on the attainment gap between poorer pupils and their ...
inforightsjames's user avatar
2 votes
1 answer
100 views

f statistic for multiple multivariate regression?

I've not seen an example of multiple multivariate regression use an F statistic, is it still valid here? (Would the f stat follow the f distribution under the null hypothesis?) detail Given n paired ...
eretmochelys's user avatar
0 votes
0 answers
20 views

Aggregating T-statistics and F-statistics across monthly cross-sectional regressions

I am trying to replicate the results in Table V of the paper Individualism and Momentum around the World (2010) by Chui et al. This is attached herewith. Dataset: Dependent variable: Monthly returns ...
dbjax's user avatar
  • 1
0 votes
0 answers
21 views

Suitability of an F test for proportion data?

I'm reading a paper where the authors have 3 related time series based on proportion data. They test for a change in these proportions by using an F test and state that this allows them to check ...
adkane's user avatar
  • 909
0 votes
0 answers
78 views

Converting Chi square to F-values

I am running Type II sum of squares tests on my linear models using the Anova() function. I prefer Type II over Type III due to its hierarchical nature. With this function, however, I am only getting ...
bluebird8's user avatar
0 votes
0 answers
67 views

F-statistic Two stage least squares (2SLS) regression

In Wooldridge's advanced book, on page 105, the F-statistic for 2SLS regression is introduced. Let me illustrate the computation step by step with the following concrete example: \begin{equation} \...
Maximilian's user avatar
1 vote
1 answer
17 views

F-statistic for classification, two ways to calculate the numerator; are they the same?

This question on F-scores for classification problems (specifically for classification; f_classif) has two answers. Each answer shows a different way to calculate F-...
Nate Anderson's user avatar
0 votes
1 answer
30 views

ANOVA: testing homogeneity of variance via D’Agostino- Pearson test?

I would be grateful for a cross-check on my understanding of the criteria for valid ANOVA analysis. The orthodoxy I've always used is the Hartley’s Fmax test, if that fails ANOVA is simply no-go. The ...
M__'s user avatar
  • 113
4 votes
1 answer
650 views

Why am I seeing a low F-statistic, but a very significant p-value in permanova?

So I am having some numbers which I can't understand...basically I am performing a permanova test using the adonis2 function, from the vegan package, and what I see ...
gabt's user avatar
  • 207
7 votes
1 answer
2k views

Why would an instrumental variable have its strength measured by an F-statistic?

A typical "rule of thumb" for instrumental variables is that an F-statistic of ten or higher indicates a strong instrument. This is mentioned in this Cross Validated post, which contains a ...
Dave's user avatar
  • 61k
3 votes
0 answers
28 views

Power analysis of a chunk test

I set up following chunk test in R: restricted Model <- DV ~ IV1 unrestricted Model <- DV ~ IV1 + IV2 + IV3 anova(restricted Model, unrestricted Model) ...
crobo's user avatar
  • 61
2 votes
1 answer
338 views

How to calculate F-statistic given only coefficient, standard errors and confidence intervals in R [closed]

My output is a table of coefficients, together with standard errors and 90 % confidence intervals, nothing else. I miss the degrees of freedom but I do have the number of observations. How can I ...
Irazall's user avatar
  • 170
1 vote
1 answer
76 views

Comparison between regression outputs to transformed and untransformed data

I want to investigate whether the values of ten dependent variables (collected in a monthly resolution) are influenced by time (in years), and, for this, I intend to perform ten linear regressions, ...
user avatar
1 vote
1 answer
79 views

Degrees of freedom of Sample Variance of Residuals (Chi-Square distribution?

In the context of jointly testing J linear restrictions, I am reviewing the distribution of the F-statistic, which is F(J, n-k). Below, R is a full row rank Jxk matrix, q is a Jx1 vector, and the null ...
pommefatale's user avatar
0 votes
0 answers
109 views

Overly strong IV?

I heard that a too high F-statistic in the first stage of an instrumental variable regression can also be bad because it means that the IV is highly correlated with other endogenous variables. Does ...
Papayapap's user avatar
  • 351
0 votes
0 answers
32 views

F statistic for regression equation

I was searching for some public material on F-static for multiple regression equation and come across with this link https://www.statisticshowto.com/probability-and-statistics/f-statistic-value-test/#:...
bogus's user avatar
  • 65
2 votes
1 answer
376 views

Unusally high F value ANOVA

I am running a one-way ANOVA to compare a numeric continuous variable between four groups, and getting a very high F-value. Below are the descriptives and code I used in R (I get similar values when ...
Pearlharborrules's user avatar
1 vote
1 answer
579 views

Is a huge F-statistic OK?

I ran a multivariate regression model in R and got an overall F-statistic of 3,525.690 and three stars attached to it. This seems to be quite good from a statistical point of view. However, should I ...
TFT's user avatar
  • 133
1 vote
0 answers
27 views

Help me find (ok, calculate/approx/uncover) the p-value in the following tables

For a meta-analysis I am looking for the p-values in these tables derived from reports dating back to 1980... I am, by now, pretty sure I can't but maybe there is someone smarter than me here... If ...
DeMelkbroer's user avatar
0 votes
0 answers
213 views

What could cause the F-statistic to increase but adjusted $R^2$ to decrease?

I have created two multiple linear models of the same data. The two models vary only in the dropping of a few variables. Model_A includes all X independent vars (A,B,C,D): Model_B includes only A,B ...
Michael Latter's user avatar
0 votes
0 answers
86 views

In f- statistic :Why do we multiply the Sum of squares with the sample size?

In the f statistic formula In the numerator, why do we multiply the sum of squares with the sample size?! Scenic we are interested only in the variation of sample means from the grand mean.
Ahmed abo-alata's user avatar
1 vote
1 answer
43 views

Finding F-statistics in R [closed]

Original model: ln(chnimpt) = β0 + β1 ln(chempit) + β2 ln(gast) + β3 ln(rtwext) + β4bef ile6t + β5aff ile6t + β6af dec6t + ut Problem Set: Add monthly dummy ...
lissa's user avatar
  • 11
3 votes
1 answer
3k views

How to interpret a significant F-statistic but low R-squared?

I have never seen it, but using a dataset of 10k observations, a simple linear regression resulted in a significant F-statistic (over all variables), but a low R-squared. I interpret it as that the ...
Snowflake's user avatar
  • 1,165
2 votes
0 answers
2k views

Granger Causality and F statistic

I am trying to educate myself in Granger Causality reading the classic literature. From what I have understood the idea is quite simple: first, to test if $X_t$ Granger causes $Y_t$ we define two ...
AbateFaria's user avatar
0 votes
0 answers
186 views

What is a test statistic? [duplicate]

Quick question: Are test statistics like the "F" and "t-statistic" the number of standard deviations on an F and t-distribution, respectively? For example, if I got a "t" ...
Nate's user avatar
  • 1,479
0 votes
0 answers
96 views

Using an APA format, how do I report an F-statistic with a value of 2.67e+30?

I am doing a statistical report on a regression model and my F-statistic is 2.67e+30. The values of my dependent and independent variables are expressed in dollars.
Camille Orpilla's user avatar
4 votes
1 answer
481 views

Conceptual/Math/brainteaser Question: Multiple Linear Regression

This is kind of a brainteaser and I'm struggling to solve it, any ideas on approaching this would be valued: I thought about using substitution of the different x and z into the third regression ...
delucaenzo's user avatar
1 vote
0 answers
111 views

Reconciling F-statistic derived in two different ways

Background: in the full-rank model let $\mathbf{b}$ be a $p\times 1$ matrix of independent standard normal random variables and $\mathbf{X}$ a $n\times p$ matrix where $\mathbf{y} = \mathbf{Xb} + \...
i_love_chocolate's user avatar
0 votes
0 answers
126 views

Will ranking "correlation" of variables by Pearson's return the same results as chi-square and F stats?

Generally speaking my understanding and experience is that when I have some target variable and want to see which other variables best correlate with it (for instance to build a predictive model), ...
Josh's user avatar
  • 308
9 votes
2 answers
1k views

Why is the F-Statistic $\approx$ 1 when the null hypothesis is true?

I'm currently reading through the section on linear regression in ISLR, and the authors use the F-Statistic to determine if we should reject the null hypothesis (well they use the p-value of the F-...
BeepBoop's user avatar
  • 205
1 vote
1 answer
41 views

Do I need F-statistic and t-statistic for regression if I have the p-value?

I am running a simple linear regression, and was wondering whether I need to use the F-statistic and t-statistic to: prove the significance of my results run a two-tailed hypothesis test on the ...
Munir Malik's user avatar
3 votes
1 answer
1k views

f_regression in sklearn - how is a correlation converted into an F score?

From the following link: https://scikit-learn.org/stable/modules/generated/sklearn.feature_selection.f_regression.html#sklearn.feature_selection.f_regression There's: This is done in 2 steps: The ...
baxx's user avatar
  • 936
5 votes
1 answer
6k views

Interpretation of F-statistics in a linear mixed model

I was reading a paper yeaterday, and in their results they reported an F-score for each of their fixed effects in a linear mixed effect model. Here, lux is a catagorical variable, but the rest are ...
RTbecard's user avatar
  • 430
2 votes
2 answers
2k views

What does it mean if I have a high F-stat but low $R^2$?

As far as I understand, a high F-stat leads to a high $R^2$, though the converse is not true. What does it mean if I have a high F-stat and a low $R^2$?
pythonuser's user avatar
1 vote
0 answers
752 views

Which F statistic is generated in felm (R) and why does it differ from STATA (ivreghdfe)

I'm running 2sls and making sure that my results replicate in both stata and r. In r, using felm, my code is: ...
Alyssa Huberts's user avatar
1 vote
0 answers
69 views

Looking for the name of a distribution and/or a way to calculate its cumulative distribution function

For parameters $\nu_1$, $\nu_2$, $\lambda$, define random variables using a chi-squared distribution and a non-central chi-squared distribution: $$ S \sim \chi^2_{\nu_2} / \nu_2 $$ $$ F \sim \frac{\...
Paul Harrison's user avatar
0 votes
1 answer
378 views

How to Properly Interpret the Hypotheses/Results of a Permutation Test Based on the Test Statistic?

I asked a question recently: Is This an Appropriate Application of a Permutation Test?. All information about my data, the permutation test and the results can be found there, but here is a quick ...
DTMD422's user avatar
  • 65
5 votes
1 answer
481 views

Is this an Appropriate Application of a Permutation Test?

Suppose I have count data between three groups, each with a different number of observations: $n_1 = 11, n_2 = 6$ and $n_3 = 5$. My data is listed below: \begin{array} {|r|r|}\hline group 1 & ...
DTMD422's user avatar
  • 65
0 votes
0 answers
258 views

Which ANOVA function use is correct in R

So, I am just a beginner in statistics and RStudio, and I still do not understand fully the full purpose of F-tests (beside hypothesis testing) and I recently started using anova() function from R ...
GreatDuke's user avatar
  • 101
0 votes
0 answers
18 views

Why is the use of the F-Statistic / p-value as a criteria in Stepwise Model Selection outdated? [duplicate]

I am coming from the field of psychology and in most publications Model Selection (OLS, Regression) is done via Forward/Backward Selection using the F-Static/p-value of the regression coefficients to ...
platypus's user avatar
1 vote
1 answer
329 views

How do R-squared and p(F-statistic) impact the fitness of a linear regression model?

Given below the attached summary statistics of a linear regression model. Noting that Adjusted R-square is only 15% but p(F-statistic) is very low (almost equal to zero): Can it be said that it is a ...
ashish.g's user avatar
  • 113
2 votes
0 answers
3k views

What is the difference between the Pseudo F Index and the F Statistic?

I'm wondering what the difference between the Pseudo F Index and the F Statistic is. The Pseudo F Index is used in clustering analysis as an index to determine the the right number of clusters in a ...
SCW16's user avatar
  • 133
1 vote
0 answers
25 views

Proof that a model has a higher $R^2$ if F > 1

I need to prove that a model has a higher adjusted $R^2$ than another model if the F-statistic is greater than 1. Below is as far as I've gotten, but I'm not even sure if that's correct. $$R^2_{adj} ...
proofs_challenged's user avatar
0 votes
0 answers
49 views

Multitaper F statistics

I'm having some problems interpreting the F-statistics output from multitaper analysis. To illustrate, the following code-snip in R performs multitaper analysis on the same sine-frequency but with ...
tbhmbi's user avatar
  • 1
5 votes
2 answers
216 views

Why is this statistic F-distributed?

A book I'm reading claims that the statistic: $\frac{(RSS_0 - RSS_1) / (p_1 - p_0)}{RSS_1 / (N - p_1 - 1)}$ has an F distribution. Why is this? I know that an F distribution is something like $\frac{\...
serendipity's user avatar
0 votes
0 answers
659 views

Difference between Wald statistics and effect size in regression models

In some of my regression models (using the rms package), I notice a distinct difference between the result of the Wald statistics (estimated using ...
Gux's user avatar
  • 355
2 votes
1 answer
2k views

How to prove that the robust F statistic is asymptotically chi squared distributed?

The linear model is $$y_{i}= x_{i}'\beta+u_{i}$$ When written in vector notation such that $y_{i}$ is a $1$ x $1$ matrix of outcomes, $x_{i}'$ is a $1$ x $k$ matrix of control variables, $\beta$ ...
user9903833's user avatar
2 votes
0 answers
62 views

F ratios, ANOVA, and 2 stage nested (mixed) models in R

I have data relating to strength of fabric. Each fabric comes from one of 4 batches (B), and batches come from one of 3 suppliers (A). My question relates to the calculation and interpretation of F ...
StatisticsPersonInTraining's user avatar
0 votes
0 answers
459 views

find F-statistic using R output

I have this R output: ...
Dries De Witte's user avatar