I am currently going through the Research paper "Deep Learning for Image recognition" by Kaiming He. I don't quite understand the concept of shortcut connections. Suppose the input to the residual learning layer shown below is an image of size 32x32. As per my understanding, after the two convolution layers shown in the figure the dimension of the output will decrease to 28x28. Building block in a non-Bottleneck ResNet

How is then the element wise addition of this 28x28 image and the 32x32 input image possible?

Is the convolution mentioned in this layer not the same as in CNN?


Newstein already answered your question, but even if dimensions of conv output and $x$ are different, they say the following (section 3.2 of the paper):

"The dimensions of $x$ and $F$ must be equal in Eqn.(1). If this is not the case (e.g., when changing the input/output channels), we can perform a linear projection $W_s$ by the shortcut connections to match the dimensions".

  • $\begingroup$ actually, shortcut connection is a (1x1) convolution layer, my question is that do i need to use activation function in that shortcut connection? $\endgroup$ – Sudip Das Mar 15 '18 at 8:57

The 3x3 convolution is performed with a zero-padding of 1 layer, so that the dimensions remain unchanged.

ie., 32x32 -> zero-padding-> 34x34 -> 3x3 conv -> 32x32


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.