Does the universal approximation theorem for neural networks hold for any activation function (sigmoid, ReLU, Softmax, etc...) or is it limited to sigmoid functions?
Does the universal approximation theorem for neural networks hold for any activation function?
Skander H.
- 12.1k
- 2
- 44
- 99