Linked Questions

1
vote
0answers
65 views

How is ANOVA related to general linear models? [duplicate]

I am new to stats and this is a silly question, but I just cannot see how ANOVA is related to general linear models. I am learning about GLM and all the materials I found are saying that ANOVA is a ...
303
votes
18answers
109k views

What happens if the explanatory and response variables are sorted independently before regression?

Suppose we have data set $(X_i,Y_i)$ with $n$ points. We want to perform a linear regression, but first we sort the $X_i$ values and the $Y_i$ values independently of each other, forming data set $(...
92
votes
5answers
13k views

Why is ANOVA taught / used as if it is a different research methodology compared to linear regression?

ANOVA is equivalent to linear regression with the use of suitable dummy variables. The conclusions remain the same irrespective of whether you use ANOVA or linear regression. In light of their ...
51
votes
4answers
29k views

Why is ANOVA equivalent to linear regression?

I read that ANOVA and linear regression are the same thing. How can that be, considering that the output of ANOVA is some $F$ value and some $p$-value based on which you conclude if the sample means ...
53
votes
2answers
94k views

What does having “constant variance” in a linear regression model mean?

What does having "constant variance" in the error term mean? As I see it, we have a data with one dependent variable and one independent variable. Constant variance is one of the assumptions of linear ...
19
votes
5answers
32k views

What is the best way to visualize relationship between discrete and continuous variables?

What is the best way to show a relationship between: continuous and discrete variable, two discrete variables ? So far I have used scatter plots to look at the relationship between continuous ...
10
votes
4answers
31k views

How to visualize independent two sample t-test?

What are the most accepted ways to visualize the results of an independent two sample t-test? Is a numeric table more often used or some sort of plot? The goal is for a casual observer to look at the ...
21
votes
4answers
11k views

Difference between regression analysis and analysis of variance?

I am learning right now about regression analysis and the analysis of variance. In regression analysis you have one variable fixed and you want to know how the variable goes with the other variable. ...
5
votes
2answers
14k views

Relationship between regressing Y on X, and X on Y in logistic regression

Correlation and linear regression are sometimes distinguished in statistics books by saying that the former is symmetric and the latter is asymmetric in the following sense: in the case of correlation,...
9
votes
1answer
5k views

R: Anova and Linear Regression

I am new to statistics and I am trying to understand the difference between ANOVA and linear regression. I am using R to explore this. I read various articles about why ANOVA and regression are ...
3
votes
1answer
7k views

Effect of sample size in F-test?

Having worked hard to understand the t-test, I'm rapidly falling out of love with it. All that is required in the t-test to gain significance is increase sample size, which renders it close to ...
22
votes
1answer
1k views

Common statistical tests as linear models

(UPDATE: I dived deeper into this and and posted the results here) The list of named statistical tests is huge. Many of the common tests rely on inference from simple linear models, e.g. a one-sample ...
4
votes
3answers
370 views

Multiple linear regression where explanatory variables almost always equal 0

I'm trying to do a multiple linear regression model to correlate a dependent $Y$ variable (normally distributed) against a set of 642 variables. These 642 variables codify for the presence or absence ...
18
votes
1answer
910 views

Cheat Sheet ANOVA Alphabet Soup & Regression Equivalents

Can I get help completing this tentative (in progress) attempt at getting my bearings on ANOVA's and REGRESSION equivalents? I have been trying to reconcile the concepts, nomenclature and syntax of ...
7
votes
1answer
394 views

What is the intuition behind (M)ANCOVA and when/why should one use it?

As per my understanding here's the what/why/when of the following hypotheses tests in a crude sense: t-test: Used when comparing means between two samples ANOVA (one way): Used when you have one ...

15 30 50 per page