In A fast learning algorithm for deep belief nets, the authors use the term "undirected associative memory". I am not sure what they are referring to, and unfortunately Google searches for this term all seem to refer back to this paper. This leads me to believe the authors are unique in using this terminology and it is probably synonymous with some more commonly used term. Perhaps in 2006 scholars knew what it was, but I can't be sure.

Is it just a Hopfield Network?


I believe that in the context of this paper, it is simply referring to a Restricted Boltzmann Machine (RBM).

(1) A technical report by Dr. Benjio has a brief summary of the aforementioned paper in section 6.1. He directly refers to the top layers as an RBM (the original paper called the top layers an "undirected associative memory").

(2) RBMs are sometimes called associative memories, see this Quora post for instance.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.