Skip to main content
edited tags
Link
Franck Dernoncourt
  • 47.6k
  • 33
  • 179
  • 293
Source Link
user1885116
  • 2.4k
  • 4
  • 25
  • 27

Restricted Boltzmann machines - update rule

I am trying to wrap my head around Geoff Hinton's RBM tutoral on http://www.cs.toronto.edu/~hinton/absps/guideTR.pdf

I understand that the log gradient update rule requires us to take an unbiased sample from the data (e.g. a random training sample) and an unbiased sample from the model. To obtain an unbiased sample from the model - one can perform Gibbs sampling until convergence.

Here i am getting confused. If one performs Gibbs sampling until convergence - has one not already found the equilibrium of the RBM, and hence the update becomes irrelevant? Please point out my lack of understanding and conceptual error.