Timeline for Explanation of Spikes in training loss vs. iterations with Adam Optimizer
Current License: CC BY-SA 3.0
6 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Dec 4, 2018 at 14:52 | answer | added | ragulpr | timeline score: 25 | |
| Sep 21, 2018 at 11:56 | history | edited | amoeba |
edited tags
|
|
| Jun 19, 2018 at 21:54 | comment | added | mxdbld | For future notice, lowering your initial learning rate can help eliminate spikes in Adam | |
| May 18, 2018 at 15:36 | vote | accept | Abdul Fatir | ||
| Sep 20, 2017 at 18:15 | answer | added | xboard | timeline score: 34 | |
| Sep 19, 2017 at 9:30 | history | asked | Abdul Fatir | CC BY-SA 3.0 |