Timeline for How can it be trapped in a saddle point?
Current License: CC BY-SA 3.0
15 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jun 9, 2017 at 2:12 | comment | added | Charlie Parker | I'm confused what your asking. Are you confused why SGD is not able to get trapped in saddle point because of the inherit noise SGD has, so according to you it should be able to escape? (unlike if it was full batch GD then if the gradient is zero and no noise then it can't escape, is that what your asking?) | |
| Jun 9, 2017 at 1:51 | answer | added | Ali Abbasinasab | timeline score: 4 | |
| S May 15, 2017 at 16:15 | history | bounty ended | Sorrow | ||
| S May 15, 2017 at 16:15 | history | notice removed | Sorrow | ||
| May 12, 2017 at 1:05 | answer | added | Antimony | timeline score: 22 | |
| May 11, 2017 at 15:02 | answer | added | Aksakal | timeline score: 0 | |
| May 11, 2017 at 13:26 | comment | added | EngrStudent | Moti gets it. The saddle point with very high slopes and surrounded by zero slope launches a gradient descent with large-steps into "the badlands" from which it cannot recover. Think about looking for a well on an essentially flat plain. Now think about the well as dry, and with an ant-hill in the center. A gradient-descent that lands on the ant-hill, but not at the exact top, is going to shoot the search out radially. Now imagine that the step-size for the search is a thousand times larger than the diameter of the well. If the search ever finds the well, the anthill shoots it to montana | |
| May 11, 2017 at 13:14 | answer | added | MotiNK | timeline score: 0 | |
| May 11, 2017 at 12:50 | history | edited | GeoMatt22 | CC BY-SA 3.0 |
fix typos, remove "saddle point approximation" tag
|
| S May 11, 2017 at 12:44 | history | bounty started | Sorrow | ||
| S May 11, 2017 at 12:44 | history | notice added | Sorrow | Authoritative reference needed | |
| May 10, 2017 at 10:11 | history | tweeted | twitter.com/StackStats/status/862248608036466688 | ||
| May 7, 2017 at 17:48 | history | edited | Fixining_ranges | CC BY-SA 3.0 |
edited body
|
| May 7, 2017 at 15:33 | review | First posts | |||
| May 7, 2017 at 15:54 | |||||
| May 7, 2017 at 15:24 | history | asked | Fixining_ranges | CC BY-SA 3.0 |