Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It only takes a minute to sign up.
Sign up to join this community
Is it possible to train a simple perceptron with a threshold activation function such as this one: https://en.wikipedia.org/wiki/Perceptron with Backpropagation instead of the perceptron rule?
is it a problem that threshold functions are not defined around 0?
No, it is not possible. In order to use backprop you have to have non-zero derivatives of the function. Derivative of the step function is zero everywhere.
