Questions tagged [nesterov]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
0answers
907 views

Nesterov's Momentum (or Accelerated Gradient)

This might be a silly question, but here it is anyway. I'm trying to implement Nesterov's Momentum to extend the gradient descent algorithm that I'm currently using for my neural network, where I'm ...
1
vote
1answer
769 views

Trying to write Nesterov Optimization - Gradient Descent

Problem: Im unsure if I understood Nesterov Optimization Im writing about Nesterov Optimization, but the notation im using seems different from the references below. I have done it using some books ...
11
votes
1answer
11k views

How to choose between SGD with Nesterov momentum and Adam?

I'm currently implementing a neural network architecture on Keras. I would like to optimize the training time, and I'm considering using alternative optimizers such as SGD with Nesterov Momentum and ...