Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 245599

A sigmoid function is a mathematical function having a characteristic "S"-shaped curve or sigmoid curve. Often, sigmoid function refers to a special case of the logistic function. It is closely related to the logistic regression.

4 votes

What are the advantages of ReLU over sigmoid function in deep neural networks?

I read all the answers and still feel that I need to write a new one. Let us consider a linear activation function g(z)=z, which is different from Relu(z) only in the region z<0. If all activation fun …
Youjun Hu's user avatar
  • 181