Skip to main content

How to derive errors in neural network with the backpropagation algorithm?

From this video by Andrew Ng around 5:00

enter image description here

How are $\delta_3$ and $\delta_2$ derived? In fact, what does $\delta_3$ even mean? $\delta_4$ is got by comparing to y, no such comparison is possible for the output of a hidden layer, right?

qed
  • 2.8k
  • 4
  • 26
  • 36