10
$\begingroup$

Does a function in the form $e^x/(1+e^x)$ have a standard name? E.g. $y = a + bx$ is a linear function.

$\endgroup$
6
  • 5
    $\begingroup$ it's the standard logistic function (en.wikipedia.org/wiki/Logistic_function) $\endgroup$ – gazza89 Oct 11 '18 at 19:32
  • 5
    $\begingroup$ It is the "Sigmoid" function. More commonly expressed as the equivalent $1 / (1 + e^{- x}).$ $\endgroup$ – Bridgeburners Oct 11 '18 at 19:32
  • 7
    $\begingroup$ @Bridge "Sigmoid," as suggested by its ending "...oid," is a generic description of any function whose graph is roughly s-shaped. It therefore is a poor (albeit common) choice of term to use when you really do mean the logistic function. $\endgroup$ – whuber Oct 11 '18 at 20:01
  • 4
    $\begingroup$ @whuber indeed; it is annoying to nowadays have to ask what the person using "sigmoid" actually intends, whereas some time ago it was safe to assume it took its literal meaning. $\endgroup$ – Glen_b Oct 11 '18 at 21:34
  • 1
    $\begingroup$ @Bridgeburners For example the inverse probit function and complementary log-log link functions are also sigmoid functions. $\endgroup$ – Alexis Oct 17 '18 at 15:42
26
$\begingroup$

It does not have a standard name. In different areas of statistics, it has different names.

In the neural networks and deep learning community, it is called the sigmoid function. This is confusing for everyone else, because sigmoid is just a fancy way of saying "S-shaped" and this function is not unique among S-shaped functions; for example, $\tanh$ is also S-shaped and widely used in neural networks, yet it is not commonly termed "sigmoidal" in neural network literature.

In the GLM literature, this is called the logistic function (as in logistic regression).

If the logit function is $$\text{logit}(p)= \log\left(\frac{p}{1-p}\right)= \log(p)-\log(1-p)=x$$ for $p\in(0,1)$, then $$\text{logit}^{-1}(x)= \frac{\exp(x)}{1 + \exp(x)}= \frac{1}{1+\exp(-x)}= p$$ for $x\in\mathbb{R}$. This is the reason some people call $\text{logit}^{-1}$ the inverse logit or anti-logit function. (Thanks, Glen_b!) However, I have not seen the reasoning by analogy from trigonometric functions, such as $\sin^{-1}$ and arcsine, carried over to $\text{logit}^{-1}$. That is, arclogit is not a name that I've seen used.

Rarely, I've seen the name expit used; as far as I can tell, this is a back-formation from the word logit but never really caught on. (Thanks, CliffAB!)

$\endgroup$
3
  • 2
    $\begingroup$ arc has a specific meaning for inverse trigonometric functions as the inverse of any trigonometric function is, or at least is equivalent to, an angle. It's a pity that this is misunderstood quite often for inverse hyperbolic functions where notations like arcsinh are sometimes encountered. There the inverse does have interpretation as an area and indeed arsinh is better (or asinh). Careful pronunciation may be advisable depending on accent and audience. But arc really can't carry a general meaning of inverse. $\endgroup$ – Nick Cox Nov 29 '18 at 17:07
  • $\begingroup$ I'd say expit is growing slowly for inverse of logit. But it's still rare in what I read. $\endgroup$ – Nick Cox Nov 29 '18 at 17:09
  • $\begingroup$ @NickCox Thanks for the helpful context about arc. Indeed, the Google ngram viewer appears to support your observation about the usage of "expit." books.google.com/ngrams/… But for some reason the largest end year allowed is 2008. :-\ $\endgroup$ – Sycorax Nov 29 '18 at 17:11

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.