Search Results
| Search type | Search syntax |
|---|---|
| Tags | [tag] |
| Exact | "words here" |
| Author |
user:1234 user:me (yours) |
| Score |
score:3 (3+) score:0 (none) |
| Answers |
answers:3 (3+) answers:0 (none) isaccepted:yes hasaccepted:no inquestion:1234 |
| Views | views:250 |
| Code | code:"if (foo != bar)" |
| Sections |
title:apples body:"apples oranges" |
| URL | url:"*.example.com" |
| Saves | in:saves |
| Status |
closed:yes duplicate:no migrated:no wiki:no |
| Types |
is:question is:answer |
| Exclude |
-[tag] -apples |
| For more details on advanced search visit our help page | |
Results tagged with neural-networks
Search options not deleted
user 212133
Artificial neural networks (ANNs) are a broad class of computational models loosely based on biological neural networks. They encompass feedforward NNs (including "deep" NNs), convolutional NNs, recurrent NNs, etc.
7
votes
4
answers
4k
views
Expectation Maximization and Deep Learning
Most papers define the learning as maximizing the expectation given some function.
$$\max_\theta \operatorname{\mathbb E}_{p_\theta(\mathbf x)} [p_\theta(\mathbf x \mid \mathbf z)]$$
Is the expectat …
- 505
2
votes
1
answer
97
views
FGSM vs Gradient Descent
FGSM as described by Goodfellow et al takes the sign of the gradient of a model w.r.t. the input. And then performs gradient descent (or ascent, depending on your objective).
However why not use dir …
- 505
1
vote
definition of "hidden unit" in a ConvNet
I don't think either of the answers provides a clear definition, so I will attempt to answer it because I stumbled into the same problem finding a clear definition of a hidden unit in the context of a …
- 505
3
votes
1
answer
649
views
How to convert VAE L2 Reconstruction Loss to a Log Likelihood
I have been puzzled trying to convert MSE to Log Likelihood in VAEs. Relevant Questions:
What is bits per dimension (bits/dim) exactly (in pixel CNN papers)?
Why is mean squared error the cross-ent …
- 505
5
votes
1
answer
313
views
Ablation Study training until when?
Given that deep learning models can take weeks to train, having to train 20 different models becomes infeasible when performing an ablation study. Are there some formally accepted common practices on …
- 505
1
vote
Ablation Study training until when?
There are no common practices for ablation experiments that are widely accepted by the community and this remains an open-problem at the time of writing.
This is a subject I have been actively working …
- 505
9
votes
2
answers
5k
views
How does the bottleneck z dimension affect the reconstruction loss in VAEs
I have come across few VAE papers that all report a similar metric bits/dim
Many (if not all) fail to mention the bottleneck size of the z space. I do know that this would directly affect the recons …
- 505