0
$\begingroup$

As I found in some tutorials, they didn't perform BN on last layer. It seems like a best practice, but I didn't find any detailed explanation of why this helps training.

Can anyone kindly help me brief the reason for why doing this?

$\endgroup$

1 Answer 1

1
$\begingroup$

On a final layer you don’t want to make any transformations beyond those needed to transform your outputs to appropriate form, i.e. change shape, for classification scale to unit range, or -1 to +1, for regression not use any activation, or use something as ReLU, or exponential function if the outputs need to be non-negative etc.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.