0
$\begingroup$

Noob question.

Okay I am beginning with MLPs and machine learning.

Suppose that I have 2 hidden layers in an ANN that uses the sigmoid function.

So does that mean that after calculating the weighted sum of inputs from the input layer all neurons in the hidden layer will only output a value between 0 and 1 in each of the neurons ?

Or will they output a weighted sum in the hidden layers and ONLY when it goes to the output neurons will the activation function be used.

$\endgroup$
0
$\begingroup$

It's very unclear what you want, but I'll try.

Yes, the output of each sigmoidal neuron is strictly between 0 and 1 due to the definition of sigmoidal function. These outputs become input vector in the second layer, so yeah, in a sense they 'output a weighted sum in the hidden' layer. Is this what ou wanted?

$\endgroup$
  • $\begingroup$ Yes. This what I wanted. Thanks. So let me just get it straight. After calculating the weighted sum a neuron passes that sum into a sigmoid(or any activation function) and calculates a value which becomes a input for the next layer. That means all neurons pass the weighted sum through an activation function, I mean there is no neuron that passes just the weighted sum to the next layer without the activation function, RIGHT ??? $\endgroup$ – Machina333 Jan 22 '16 at 13:04
  • $\begingroup$ You can use the linear function, i.e. $f(x) = x$, it is even continuous, but what's the point? $\endgroup$ – Alex Jan 22 '16 at 13:05
  • $\begingroup$ Exactly, so the activation is done at every hidden layer. You see I am not confused about the parameters. I am confused about the fact that after calculating the parameters is the final result passed through an activation function in the hidden layer(NOT the OUTPUT LAYER) $\endgroup$ – Machina333 Jan 22 '16 at 13:08
  • $\begingroup$ 'after calculating the parameters'-?? I'm sorry, it's very unclear what you want. 'calculating the parameters', i.e. weights and hidden unit expressions are very different things $\endgroup$ – Alex Jan 22 '16 at 13:10
  • $\begingroup$ Sorry after multiplying the inputs with the weights. $\endgroup$ – Machina333 Jan 22 '16 at 13:10

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.