Timeline for Mean or sum of gradients for weight updates in SGD
Current License: CC BY-SA 4.0
7 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Nov 5, 2019 at 14:54 | history | edited | Sycorax♦ | CC BY-SA 4.0 |
edited title
|
Feb 17, 2019 at 20:41 | history | edited | Sycorax♦ | CC BY-SA 4.0 |
added 4 characters in body
|
Jul 26, 2018 at 9:38 | vote | accept | pg2455 | ||
Jul 25, 2018 at 15:31 | history | edited | Sycorax♦ |
edited tags
|
|
Jul 25, 2018 at 15:31 | answer | added | Sycorax♦ | timeline score: 22 | |
Jul 24, 2018 at 20:23 | comment | added | pg2455 | I was assuming that learning-rate is not dependent on the batch size. Given everything else is same I think I should average out gradients or gradients will cumulate over samples. | |
Jul 24, 2018 at 19:43 | history | asked | pg2455 | CC BY-SA 4.0 |