This is my network represented in matrices: (The dot represents a number)
Feed-forwarding:
Backpropagation
The question
What did go wrong?
I suppect it's because I have to intialize my bias with the shape of (neuronsInGivenLayer, batch_size) as opposed to (neuronsInGivenLayer, 1) ?