In artificial neural networks, the sigmoid and complementary log log activation functions are similar in shape when plotted on a graph. I would like to know when to use the two functions and their pros and cons. Thanks in advance :)


This paper is behind a pay-wall but is one of the only references that I've found.

Gecynalda S. da S. Gomes & Teresa B. Ludermir. "Complementary Log-Log and Probit: Activation Functions Implemented in Artificial Neural Networks"

The types of activation functions most often used in artificial neural networks are logistic and hyperbolic tangent. Activation functions used in ANN have been said to play an important role in the convergence of the algorithms used. This paper uses sigmoid functions in the processing units of neural networks. Such functions are commonly applied in statistical regression models. The nonlinear functions implemented here are the inverse of complementary log-log and probit link functions. A Monte Carlo framework is presented to evaluate the results of prediction power with these nonlinear functions.

  • $\begingroup$ I highly appreciate your answer. I will look into this reference. Thank You :) $\endgroup$ – Thilina Samiddhi Jun 3 '18 at 13:30

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.