I understand that the various kernels used at each layer are learned via back propagation. But how do you decide how many will be used at each layer and how/are these kernels represented in the NN diagram?
I am aware that a major difference between the first and second diagram is that the first is fully connected and the second is not. But I do not understand how it is possible to have multiple kernels run over the image in one layer. Looking at the first diagram I would have assumed that each layer would be responsible for one and only one convolution?