1
$\begingroup$

So far, I thought federated learning works like this:

All clients have the same machine learning model (if not personalized). They have their unique data and then train this model (e.g., neural network) with their data. Then, they have a new matrix of neural network weights.

They then either share the new matrix completely with the server, or at least the changed matrix parameters.

However, in a recent post of mine, a user said:

it looks like you might also seem to think that final parameters are the things communicated upstream in federated learning. This isn't the case, it's gradient updates which go upstream.

I don't quite understand what the difference is - a neural network consists of one or several weight matrix/matrices, so this should be shared, not?

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.