1
$\begingroup$

I try to understand the differences between the MP Neuron and the Perceptron. Is my understanding right that the MP Neuron mathematically only differences in the activation function. I.e. the MP Neuron only has the Threshold function as activation function and the Perceptron can have all kinds of activation function like ReLU, Softmax etc?

MP Neuron in my understanding

enter image description here

Perceptron in my understanding

enter image description here

$\endgroup$

1 Answer 1

1
$\begingroup$

McCulloch-Pitts (MP) neurons only accept binary inputs, and the activation function is the binary threshold. Perceptron (not the algorithm) accepts real valued inputs, and it uses Heaviside step function as the activation.

$\endgroup$
2
  • $\begingroup$ ah intersting. And can you clarify what the difference is between binary threshold and heaviside step? $\endgroup$ Dec 2, 2023 at 17:15
  • 1
    $\begingroup$ Heaviside uses 0 as threshold while binary threshold can use any $T$. $\endgroup$
    – gunes
    Dec 2, 2023 at 20:51

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.