Skip to main content

New answers tagged

2 votes
Accepted

Custom Loss function Overfits to the Wrong Output but MSE Doesn't

The problem is that the loss function only has 0 gradient when the neural network output is 0. This is not desirable! Instead, we want a loss function that has a 0 gradient when the output matches the ...
Sycorax's user avatar
  • 94k

Top 50 recent answers are included