All Questions
5 questions
2
votes
0
answers
105
views
Restricted Boltzmann Machine: W matrix visualization results after training MNIST images and Pseudo-log-likelihood
I am implementing RBM from scratch using Tensorflow and after training my RBM on the MNIST dataset for 200 epochs using Persistent CD with two steps of contrastive divergence, I learn the weights W ...
- 21
5
votes
1
answer
387
views
ReLUs improve Restricted Boltzmann Machines
This question is about the use of Rectified Linear Units as hidden units in Restricted Boltzmann Machines.
In Nair and Hinton's paper, using ReLUs as hidden units is proposed. In section 1, they ...
- 291
3
votes
1
answer
210
views
Boltzmann machines: learning algorithm
I'm trying to study Boltzmann machines, so I don't undestand this recurrent formulation for the training stage of the weights $w$:
$\Delta w_{ij} = E_{data} (v_i h_j ) − E_{model} (v_i h_j )$
all ...
- 747
19
votes
2
answers
6k
views
Modern Use Cases of Restricted Boltzmann Machines (RBM's)?
Background: A lot of the modern research in the past ~4 years (post alexnet) seems to have moved away from using generative pretraining for neural networks to achieve state of the art classification ...
- 625
5
votes
0
answers
379
views
What enforces features diversity in RBM?
I'm working on an implementation of a Restricted Boltzman Machine (RBM). I made some tests on the MNIST dataset trying to learn a representation of the digit 2. My inputs are binary images. My aim is ...
- 213