# What is the weight decay loss?

I'm beginning with deep learning, and I have a question whose answer I couldn't find, maybe I haven't searched properly. I have seen this answer, but it is still not clear what is the weight decay loss and how is it related to the loss function.

## migrated from ai.stackexchange.comApr 11 '17 at 19:56

This question came from our site for people interested in conceptual questions about life and challenges in a world where "cognitive" functions can be mimicked in purely digital environment.

During training, a regularization term is added to the network's loss to compute the backpropagation gradient. The weight decay value determines how dominant this regularization term will be in the gradient computation.