12
$\begingroup$

It annoys me when people do it, a negative correlation (or relationship) means $y=-x$, and inverse means $y=1/x$.

However, I just googled it to gain some evidence to prove my point, and the first link says "A negative correlation means that there is an inverse relationship between two variables - when one variable decreases, the other increases." (Emphasis mine.)

So, do I have to eat my words? Or can I continue to tell people not to call negative relationships inverse?

$\endgroup$
8
  • 3
    $\begingroup$ I agree with you ...BUT statistics is replete with "poor english" e.g. analysis of variance rather than analysis of sums of squares etc. $\endgroup$
    – IrishStat
    Sep 19, 2015 at 22:50
  • 2
    $\begingroup$ If someone says inverse correlation, you should be prepared to accept that $r < 0$. But you're not wrong that negative correlation is more clear. $\endgroup$
    – Cliff AB
    Sep 19, 2015 at 22:50
  • 2
    $\begingroup$ It's also worth noting that if $x$ and $y$ are defined on (0, $\infty$), then an inverse correlation (as you would define it) is likely (but I don't think necessarily definitely) to imply a negative correlation :) $\endgroup$
    – Cliff AB
    Sep 19, 2015 at 22:52
  • 14
    $\begingroup$ The term "Inverse" in both mathematics and in ordinary English usage is not limited to multiplicative inverse" ($\frac{1}{x}$). In this case, being correlated with the additive inverse ($-x$) might be just as valid an interpretation. Being "inversely related" need not necessarily imply any more than what you quote ("*when one variable decreases, the other increases") -- implying a monotonic-decreasing relationship $\endgroup$
    – Glen_b
    Sep 19, 2015 at 23:44
  • 5
    $\begingroup$ It is difficult to find support for the various claims that this is "sloppy" or "poor" English. The definition of "inverse" is clear (look it up) and--as Glen_b noted--does not specifically refer to multiplicative inverses. In higher mathematics it is understood that "inverse" can mean something abstract--it will not be assumed it is a reciprocal. Indeed, it's good form--although rapidly fading from the language--to describe "direct" and "inverse" relationships in a qualitative sense among quantities in mathematics, engineering, and statistics. $\endgroup$
    – whuber
    Nov 29, 2016 at 23:23

5 Answers 5

3
$\begingroup$

In physics, more so than other things, one has occasion to say directly related and inversely related when speaking of proportional relationships. That is inexact language use, of the type often called hand waving, with the advantage of helping students uncomfortable with the concept of proportionality to grasp the essentials of proportionality without using the word. More exact phraseology would be directly proportional and inversely proportional. Similarly, it would be rare to use the phrase directly proportional to the negative of something, as it is easier to grasp a negative slope, and rework a phrase to accommodate that.

The concept of inverse proportionality is often approached at the beginner level by hand-waving in this fashion; in this equation as $x$ increases, $y$ decreases. Although true for definite positive inverse proportionality, this has the disadvantage of not being unique, as a negative slope direct proportionality has that same property. In general, to keep the word inverse from causing confusion, all that need be done is to say inverse ______ <-- what and fill in the blank. What operation is an inverse of what other operation depends on which algebraic procedure is being used, for example, subtraction is inverse addition, division is inverse multiplication, deconvolution is inverse convolution, a matrix inverse is the inverse of an invertible matrix, an inverse Laplace transform is the inverse of a Laplace transform, and so on.

The OP's question is: Is it correct to refer to a negative correlation as an 'inverse correlation'? The answer is no, correlation is intransitive, that is, given a correlation one cannot invert the procedure. For it to be an inverse, it would have to be an inverse of some algebraic operation, and the reason for using it in this context is otherwise, namely that it is inverse hand-waving of "as $x$ increases, $y$ increases type," and hand-waving is also not a defined algebraic procedure. The unambiguous terminology for "as $x$ increases, $y$ increases" is monotonically increasing, and, to affirm that this is not local, the term strictly monotonically increasing is used, the inverse of which is then monotonically non-increasing and not strictly monotonically decreasing. Now note, the inverse of monotonically increasing is not monotonically decreasing, which demonstrates what the semantic problem is.

In that light, then, we can state that the phrase "A negative correlation means that there is an inverse relationship between two variables - when one variable decreases, the other increases." is 1) gibberish of the hand-waving type, that 2) uses the word "inverse" improperly, and which when cleaned up by replacing the all of the improper language could read "A negative correlation means that the normalized covariance is negative," furthermore 3) A negative correlation does not imply monotonicity between discrete random variables, the admixture of continuous and discrete parameter types notwithstanding, and if not totally incorrect it is a stretch to define a correlation via an ordinary least squares in $y$ linear regression model that would have monotonicity.

Finally, the OP questions So, do I have to eat my words? Or can I continue to tell people not to call negative relationships inverse? have the following answers 1) Yes, you are correct, and should not (never mind cannot) eat your words. Negative relationships imply additive inverses not proportional (i.e., multiplicative) inverses, and use of the word inverse in two separate contexts simultaneously is ill advised.

$\endgroup$
3
$\begingroup$

Short answer: You don't have to eat your words. In the context of ratio-scale measurement, negative correlation does not properly measure the inverse functional relationship.

Correlation only measures the linear component of a statistical relationship, so if there is a nonlinear statistical relationship, it may still show up as correlation, but the correlation will not fully describe the relationship. In the case of an inverse relationship $y=1/x$ (which is nonlinear), random sampling of these values certainly be negatively correlated (assuming they are both positive$^\dagger$) so it is correct to say that an inverse relationship does lead to negative correlation. However, there are many other relationships that lead to negative correlation, so it is not correct to say that negative correlation always indicates an inverse relationship.

As some commentators have pointed out, the word "inverse" can be used in its strict mathematical sense, or in a broader sense that refers generally to relationships that are "opposing" in some broad way. Notwithstanding this diversity of usage, in a mathematical context the term "inverse" does have a strict meaning, and so use of this term invites consideration of that find of function.

Whilst it is true that an inverse relationship will lead to negative correlation (again, assuming positive values), describing negative correlation as "inverse correlation" is not good practice, and you are right to be a bit uncomfortable with it. The reason this is not good practice is that correlation measures the linear part of the relationship, not functions of inverse form; calling it "inverse correlation" suggest that it is measuring the inverse component of the relationship, which is not accurate.


$^\dagger$ In fact, it is possible to obtain any correlation value (including positive values or zero) with data from the inverse function $(x_i, y_i,)$ with $y_i = 1/x_i$. To obtain zero correlation or positive correlation you can take some data from the negative-negative quadrant and some data from the positive-positive quadrant. In the body of the answer we rule this out by assuming both values are positive.

$\endgroup$
7
  • $\begingroup$ I am surprised that you assume that correlation means linear relationship. There are many concepts of correlation, as shown by many measures of the same, including measures of rank correlation. $\endgroup$
    – Nick Cox
    Jun 6, 2021 at 1:02
  • 1
    $\begingroup$ The standard correlation measure is for the linear relationship, so I don't think this is really surprising. Rank-correlation is for ordinal data so concepts pertaining to linearity/nonlinearity don't apply in that case. $\endgroup$
    – Ben
    Jun 6, 2021 at 4:17
  • $\begingroup$ You might as well regard (Pearson) correlation as a special case applying only with interval or ratio scale data. $\endgroup$
    – Nick Cox
    Jun 6, 2021 at 18:20
  • 1
    $\begingroup$ I think we may be talking at cross-purposes here. Whilst the title of the post is broad, the content refers to the distinction between two variables related by a linear function and two variables related by an inverse function. That is something that only arises in the context of ratio-scale measurement, so my discussion of "correlation" in that context refers to measures that are designed for the ratio-scale. I will edit to make that explicit so that there is no confusion. $\endgroup$
    – Ben
    Jun 6, 2021 at 23:03
  • 2
    $\begingroup$ As often happens here, a thread may be from broadened considerably from the original question by the discussion. I suspect many readers will find some of that broadening helpful and some less helpful, but no doubt there wouldn't be a consensus about which bits are which. Thanks for your willingness to tweak your answer. $\endgroup$
    – Nick Cox
    Jun 6, 2021 at 23:08
2
$\begingroup$

I guess the problem comes from a misunderstanding of the correlation term. It is highly accepted that the term correlation refers to linear correlation. Then, in a mathematical terminology, $y=-x$ the best describes negative correlation. Your term, $y=1/x$ is true if we define correlation in a non-linear space.

$\endgroup$
2
  • $\begingroup$ I don't know what "highly accepted" means. Very many introductory courses and text explain about (e.g.) rank correlation too. $\endgroup$
    – Nick Cox
    Jun 6, 2021 at 1:04
  • $\begingroup$ Pearson correlation is indirectly applicable to one form of linear regression; partial correlation for ordinary least squares. It is a mistake to say that correlation refers to linear anything, per se. Correlation is deviation normalized covariance. $\endgroup$
    – Carl
    Jun 9, 2021 at 15:42
2
$\begingroup$

To me, inverse relationship (correlation) or negative relationship means the same. When one thing goes up the other goes down. The two ends of a teeter-totter have an inverse relationship (negative relationship).

$\endgroup$
1
  • $\begingroup$ Do you interpret negative x as -x, and inverse x as -x, or 1/x? $\endgroup$ Aug 4, 2022 at 15:25
0
$\begingroup$

Yes, it is correct, and yes, you would have "to eat your words".

Arguably, this question is off-topic, as it refers to semantics and consensus, which is not a technical statistical issue, but a cultural one.

The top voted answers are biased because they appeal mostly to the same specific sub-culture of yours and people that visit Cross Validated. They define a narrow context in which words are defined and then make ethnocentric statements involving truth or correctness (whatever that is in a socially mediated process).

The truth is that people other than statisticians or mathematically-oriented people use some concepts. And concepts are used to communicate in many cases between these same people. Correlations are one of those concepts that are extensively used by non-mathematically-trained professionals. Given that the word 'inverse' predates any mathematical-specific definition given to it, it is no surprise that it is frequently (and validly) understood as:

turned in the opposite direction, having an opposite course or tendency

A different question is whether it is an ambiguous concept or not. Or, the question others have replied to here, whether the mathematical definition of it applies.

$\endgroup$
3
  • $\begingroup$ Comments are not for extended discussion; this conversation has been moved to chat. $\endgroup$
    – whuber
    Jun 8, 2021 at 16:11
  • $\begingroup$ I'm somewhat sympathetic to descriptivism but this answer proves too much. It is an argument for having no standards or definitions at all, because any definition would be the product of some culture or subculture. $\endgroup$
    – mkt
    Aug 4, 2022 at 9:54
  • $\begingroup$ I don't think this answer promotes absolute relativism. I'd argue it is the opposite, it states that in the dominating culture and language use of most people (which includes most practitioners and "users" of correlations), inverse has an intuitive, clear meaning. If a colleague at your company brings the concept and the first reflex is to argue there are no multiplicative inverses involved, that just shows a poor appraisal of context. $\endgroup$
    – Kuku
    Aug 4, 2022 at 10:03

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.