Timeline for ReLUs improve Restricted Boltzmann Machines
Current License: CC BY-SA 4.0
3 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| May 16, 2020 at 1:34 | comment | added | shimao | @q.Then sorry for the very late reply -- i believe in the relu rbm paper they used relu hidden units but gaussian visible units, so one gaussian unit == 1 pixel. however if you wanted to use relu visible units as well, then the sum of each set of infinite binary units would correspond to one pixel. | |
| Apr 20, 2020 at 15:14 | comment | added | q.Then | Hey @shimao, thanks for the great explanation, just a clarification but in this case, when we sample from the infinite binary units, how do we interpret the final value? Isn't this different from our input where we only had one visible unit per pixel (in the typical case of a image)? | |
| Jun 7, 2019 at 6:45 | history | answered | shimao | CC BY-SA 4.0 |