If you consider the central limit theorem, input data will follow a normal distribution with a constant mean. Thus, if the input data are normalized, the mean will be close to 0. So padding with 0 (the mean) doesn't affect the distribution. I have done some testings in my research, which show the output of batch normalization will follow normal distributions with the mean close to 0. Also if you know the convolution operation in the traditional signal processing, you can find that zero padding is just the standardized way.