# Loss reduction: when to use sum and when mean? [duplicate]

In the PyTorch documentation for most losses, there is a parameter called reduction usually, and it is mean, but there is also a sum option. I think optimizer can handle both of the fine, so I don't understand when to use which?