So far, I thought federated learning works like this:

All clients have the same machine learning model (if not personalized). They have their unique data and then train this model (e.g., neural network) with their data. Then, they have a new matrix of neural network weights.

They then either share the new matrix completely with the server, or at least the changed matrix parameters.

However, in a recent post of mine, a user said:

it looks like you might also seem to think that final parameters are the things communicated upstream in federated learning. This isn't the case, it's gradient updates which go upstream.

I don't quite understand what the difference is - a neural network consists of one or several weight matrix/matrices, so this should be shared, not?


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.