The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
0answers
23 views

Is a Gaussian-Gaussian RBM just a linear model?

The 'conventional' configuration of RBMs are Binary-Binary and Gaussian-Binary (and sometimes Binary-Gaussian) units. Although it is possible for both the visible and hidden units to be gaussian, ...
2
votes
1answer
13 views

Are Restricted Boltzmann Machines better than Stacked Auto encoders and why?

So I'm learning about deep learning. I first learned about stacked auto-encoders and now I'm learning about Restricted Boltzmann Machines. However non in the papers/tutorials I read I found them ...
1
vote
0answers
32 views

Rough estimates for training time of deep belief networks

I'm still learning about deep learning. However I'm currently interested to know if deep learning architectures scale well or not. Suppose I have a dataset with 1 million training examples, can you ...
1
vote
1answer
34 views

Why features compression is good?

I'm reading about deep learning and that in principles it's a features compression technique and that is why it works. Now my question is why compressing features from 200 or so into 4 is better? How ...
0
votes
0answers
15 views

Deep Belief Networks: connecting visible bias of higher layers to hidden bias of lower layer?

Suppose we are building a DBN (Deep Belief Network) and we have already trained some lower layers as Restricted Bolzmann Machines. Now we add a new layer, with new weights and new biases for the new ...
0
votes
0answers
18 views

Can not classify Iris dataset by continuous deep belief network

We have a case to map real input values into low dimensional binary vectors. So we use CDBN here, but whatever I change the parameter combinations of k, lr or epochs, it always failed to classify our ...
2
votes
1answer
33 views

Can a deep belief network (stacked RBMS) be used solely as a dataset generator?

I have a large dataset (tens of thousands of predictors) on which I would like to perform feature reduction with the intent of better model-building for prediction. Deep Belief Networks seem to ...
0
votes
0answers
14 views

How to update weights in RBM (Restricted Boltzmann Machines)?

Related Question: Learning weights in a Boltzmann Machine I'm trying to understand RBMs and how they are applied in training of Deep Architecture. Being new to the field of statistics, I stumbled ...
8
votes
1answer
160 views

Where and why does deep learning shine?

With all the media talk and hype about deep learning these days, I read some elementary stuff about it. I just found that it is just another machine learning method to learn patterns from data. But my ...
4
votes
3answers
200 views

How true is this slide on deep learning?

I was listening to a talk and saw this slide: How true is it?
2
votes
1answer
68 views

Deep Belief Network (number of layers)

So we have "several RBMs" Deep Belief Network ...
13
votes
2answers
2k views

Using deep learning for time series prediction

I'm new in area of deep learning and for me first step was to read interesting articles from deeplearning.net site. In papers about deep learning, Hinton and others mostly talk about applying it to ...
1
vote
1answer
103 views

Sampling from a Deep Belief Network: Treatment of biases in directed part of the model

When generating samples from a DBN, how do you handle the biases that have been learned for the layers below? I know that you normally perform a number of Block Gibbs sampling steps in the undirected ...
1
vote
1answer
137 views

Mathematically modeling neural networks as graphical models

I am struggling to make the mathematical connection between a neural network and a graphical model. In graphical models the idea is simple: the probability distribution factorizes according to the ...
11
votes
2answers
2k views

What is the difference between a neural network and a deep belief network?

I am getting the impression that when people are referring to a 'deep belief' network that this is basically a neural network but very large. Is this correct or does a deep belief network also imply ...
4
votes
2answers
667 views

Deep belief network performs worse than a simple MLP

I tried to train a deep belief network to recognize digits from the MNIST dataset. Everything works OK, I can train even quite a large network. The problem is that the best DBN is worse than a simple ...
1
vote
2answers
187 views

Can deep belief networks be applied to sparse feature vectors/classification problems?

I am trying to beat the performance of an SVM classifier in a text classification task. Input is a bag of words model of sentences with 1 representing presence and 0 representing absence. Output is 1 ...
18
votes
3answers
5k views

R libraries for deep learning

I was wondering if there's any good R libraries out there for deep learning neural networks? I know there's the nnet, ...