2
$\begingroup$

Does Adam optimizer applicable to either method of distributed training BSP, ASP, SSP or it can be used with synchronous mode only ?

Improve this question
$\endgroup$
1
  • $\begingroup$ Please clarify your specific problem or provide additional details to highlight exactly what you need. As it's currently written, it's hard to tell exactly what you're asking. $\endgroup$
    – Community Bot
    Jan 17, 2022 at 9:07

1 Answer 1

Reset to default
1
$\begingroup$

Adam alone in standard form is used for optimisation for a single dataset. Depending on your distributed algorithm, one can of course use Adam in local training part of algorithms, there is no restriction on that. However, there is a distributed version of Adam, so called DADAM. For DS type distributed setting, Adam can be used for local workers of course. (A)synchrony is about task scheduling rather than optimisation, so one can separate optimisation as an independent work load.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.