New answers tagged

11 votes
Accepted

What is a random variable in ADAM optimizer?

Converting my comment into an answer. The sentence right below your screenshot in the paper is the answer. The stochasticity might come from the evaluation at random subsamples (minibatches) of ...
user avatar

Top 50 recent answers are included