EDIT NOTE: I'm mostly concerned with linear regression with unconstrained y-intercept, but reading about constrained y-intercept, if relevant, is also helpful.
I noticed that for linear regression, the coefficient of determination (R-squared) can be as high as 1 (if the linear regression fits the given data perfectly). But, can it ever be zero (can there be two variables whose linear R-squared is zero)?
I grabbed some random data for dependent variable data (presumably not pseudo-random but ACTUAL random), and I plotted them against an independent variable with the linear regression; you can never really get exactly zero for R-squared (so I guess I'm answering my own question). Why is that? Does this mean that ANY two variables do have SOME linear correlation (no matter how minuscule or small this relation is)? i.e., Can I look at ANY two variables and say that there is SOME linear correlation between them?
So, the matter is NOT whether two variables are linearly correlated, but rather the EXTENT that this linear relationship explains the correlation between the two variables... right? Doesn't this apply to all other regression models (non-linear)?