# Questions tagged [f-statistic]

An F statistic is a value you get when you run an ANOVA test or a regression analysis to find out if the means between two populations are significantly different.

107 questions
Filter by
Sorted by
Tagged with
44 views

### If two IV yield distinct F-statistics in the first-stage regression, does it indicate that they are different IV, regardless of the correlation?

Suppose we are in a panel context where we are estimating while controlling for fixed effects. Let's assume that we have two instruments Z1 and Z2 for the X endogenous variable and both instrument are ...
• 11
1 vote
58 views

### Linear regression on categorical variable, how to interpret the F-statistic?

I am using statsmodels to fit a regression: smf.ols(formula=change ~ C(location))` where change is a continuous variable. I have a lot of locations and some of the ...
• 23
124 views

### Calculate $R^2$ given estimated coefficients and $N$ only

We have a simple regression equation $y=a+bx$, where $a,b$ were estimated via OLS -- we know these values. Suppose the number of observations $N=25$ is given. Is it true, that we cannot calculate $R^2$...
• 345
81 views

### Ordinary Linear Regression with One Independent Variable

I am currently undertaking a project where I aim to explore the relationship between a single independent variable and a dependent variable. I have five questions that are answered on a 5-Point Likert ...
51 views

### F-Statistic and F-distribution [duplicate]

I am reading ISLP chapter 3.2 about multiple linear regressions. F-statistic seems like to be a statistic calculated per sample. But also we know that it is just and estimation for the stat on whole ...
• 87
27 views

### Interpreting linear regression (Do grammar schools increase the attainment gap for disadvantaged pupils?)

On Monday The Education Policy Institute published its annual report on education in England https://epi.org.uk/annual-report-2023/. This focusses on the attainment gap between poorer pupils and their ...
104 views

### f statistic for multiple multivariate regression?

I've not seen an example of multiple multivariate regression use an F statistic, is it still valid here? (Would the f stat follow the f distribution under the null hypothesis?) detail Given n paired ...
• 161
25 views

### Aggregating T-statistics and F-statistics across monthly cross-sectional regressions

I am trying to replicate the results in Table V of the paper Individualism and Momentum around the World (2010) by Chui et al. This is attached herewith. Dataset: Dependent variable: Monthly returns ...
23 views

### Suitability of an F test for proportion data?

I'm reading a paper where the authors have 3 related time series based on proportion data. They test for a change in these proportions by using an F test and state that this allows them to check ...
• 1,021
110 views

### Converting Chi square to F-values

I am running Type II sum of squares tests on my linear models using the Anova() function. I prefer Type II over Type III due to its hierarchical nature. With this function, however, I am only getting ...
116 views

### F-statistic Two stage least squares (2SLS) regression

In Wooldridge's advanced book, on page 105, the F-statistic for 2SLS regression is introduced. Let me illustrate the computation step by step with the following concrete example: \...
• 309
1 vote
17 views

### F-statistic for classification, two ways to calculate the numerator; are they the same?

This question on F-scores for classification problems (specifically for classification; f_classif) has two answers. Each answer shows a different way to calculate F-...
32 views

### ANOVA: testing homogeneity of variance via D’Agostino- Pearson test?

I would be grateful for a cross-check on my understanding of the criteria for valid ANOVA analysis. The orthodoxy I've always used is the Hartley’s Fmax test, if that fails ANOVA is simply no-go. The ...
• 113
1 vote
59 views

### What makes a good control variable?

I am currently studying whether academic freedom (independent variable) has an impact on university rankings (dependent variable). So far, my model is only composed of these two variables, as well as ...
• 101
833 views

### Why am I seeing a low F-statistic, but a very significant p-value in permanova?

So I am having some numbers which I can't understand...basically I am performing a permanova test using the adonis2 function, from the vegan package, and what I see ...
• 207
3k views

### Why would an instrumental variable have its strength measured by an F-statistic?

A typical "rule of thumb" for instrumental variables is that an F-statistic of ten or higher indicates a strong instrument. This is mentioned in this Cross Validated post, which contains a ...
• 65k
35 views

### Power analysis of a chunk test

I set up following chunk test in R: restricted Model <- DV ~ IV1 unrestricted Model <- DV ~ IV1 + IV2 + IV3 anova(restricted Model, unrestricted Model) ...
• 61
471 views

### How to calculate F-statistic given only coefficient, standard errors and confidence intervals in R [closed]

My output is a table of coefficients, together with standard errors and 90 % confidence intervals, nothing else. I miss the degrees of freedom but I do have the number of observations. How can I ...
• 170
1 vote
81 views

### Comparison between regression outputs to transformed and untransformed data

I want to investigate whether the values of ten dependent variables (collected in a monthly resolution) are influenced by time (in years), and, for this, I intend to perform ten linear regressions, ...
1 vote
85 views

### Degrees of freedom of Sample Variance of Residuals (Chi-Square distribution?

In the context of jointly testing J linear restrictions, I am reviewing the distribution of the F-statistic, which is F(J, n-k). Below, R is a full row rank Jxk matrix, q is a Jx1 vector, and the null ...
117 views

### Overly strong IV?

I heard that a too high F-statistic in the first stage of an instrumental variable regression can also be bad because it means that the IV is highly correlated with other endogenous variables. Does ...
• 363
33 views

### F statistic for regression equation

I was searching for some public material on F-static for multiple regression equation and come across with this link https://www.statisticshowto.com/probability-and-statistics/f-statistic-value-test/#:...
• 65
386 views

### Unusally high F value ANOVA

I am running a one-way ANOVA to compare a numeric continuous variable between four groups, and getting a very high F-value. Below are the descriptives and code I used in R (I get similar values when ...
1 vote
978 views

### Is a huge F-statistic OK?

I ran a multivariate regression model in R and got an overall F-statistic of 3,525.690 and three stars attached to it. This seems to be quite good from a statistical point of view. However, should I ...
• 345
1 vote
28 views

### Help me find (ok, calculate/approx/uncover) the p-value in the following tables

For a meta-analysis I am looking for the p-values in these tables derived from reports dating back to 1980... I am, by now, pretty sure I can't but maybe there is someone smarter than me here... If ...
• 151
226 views

### What could cause the F-statistic to increase but adjusted $R^2$ to decrease?

I have created two multiple linear models of the same data. The two models vary only in the dropping of a few variables. Model_A includes all X independent vars (A,B,C,D): Model_B includes only A,B ...
95 views

### In f- statistic :Why do we multiply the Sum of squares with the sample size?

In the f statistic formula In the numerator, why do we multiply the sum of squares with the sample size?! Scenic we are interested only in the variation of sample means from the grand mean.
1 vote
43 views

### Finding F-statistics in R [closed]

Original model: ln(chnimpt) = β0 + β1 ln(chempit) + β2 ln(gast) + β3 ln(rtwext) + β4bef ile6t + β5aff ile6t + β6af dec6t + ut Problem Set: Add monthly dummy ...
• 11
3k views

### How to interpret a significant F-statistic but low R-squared?

I have never seen it, but using a dataset of 10k observations, a simple linear regression resulted in a significant F-statistic （over all variables）, but a low R-squared. I interpret it as that the ...
• 1,183
2k views

### Granger Causality and F statistic

I am trying to educate myself in Granger Causality reading the classic literature. From what I have understood the idea is quite simple: first, to test if $X_t$ Granger causes $Y_t$ we define two ...
• 197
204 views

### What is a test statistic? [duplicate]

Quick question: Are test statistics like the "F" and "t-statistic" the number of standard deviations on an F and t-distribution, respectively? For example, if I got a "t" ...
• 1,653
103 views

### Using an APA format, how do I report an F-statistic with a value of 2.67e+30?

I am doing a statistical report on a regression model and my F-statistic is 2.67e+30. The values of my dependent and independent variables are expressed in dollars.
547 views

### Conceptual/Math/brainteaser Question: Multiple Linear Regression

This is kind of a brainteaser and I'm struggling to solve it, any ideas on approaching this would be valued: I thought about using substitution of the different x and z into the third regression ...
1 vote