New answers tagged adam
11
votes
Accepted
What is a random variable in ADAM optimizer?
Converting my comment into an answer.
The sentence right below your screenshot in the paper is the answer.
The stochasticity might come from the evaluation at random subsamples (minibatches) of ...
- 6,987
Top 50 recent answers are included