1
$\begingroup$

Can someone explain to me what is a visible bias and what is a hidden bias in case of a Restricted Boltzmann Machine ? I know what is meant by biases but what is hidden and visible bias ?

Does visible and hidden biases only deal with RBMs or are they applicable for all neural networks ?

$\endgroup$
1
$\begingroup$

When you are propagating up from the visible layer to the hidden layer you have the rbm weights plus the bias weights, which in this upwards positive stage are called the hidden biases.

For the downward propagation from the hidden layer, after sampling the hidden layer, to the reconstruction of the visible layer you use the same rbm weights but a different set of bias weights. This second set of bias weights are the visible biases. A quick look at the rbm code at Geoff Hinton's homepage should make this much clearer.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.