3
$\begingroup$

I am reading the lectures on "Convolutional Neural Networks for Visual Recognition", and in this lecture they deal with first layer visualization. As you can see in the figure below- this figure supposed to visualize the weights of the first layer of a (fully connected) neural network. Could someone explain how exactly we get these visualizations from the weight matrix W? For example, if the input is of dimension m, and the first layer is of dimension n, the weight matrix has m*n parameters. How do we transform them into the squares depicted in the figure, and how do we decide to fix the intensities?

enter image description here

$\endgroup$
0
$\begingroup$

I'm not 100% sure but I think that for each Neuron, they create an image by just multiplying the input pixels by their weights leading to that particular neuron. You'll get results exceeding the values of what a pixel can be (0-255) and also get negative numbers, so you'll have to rescale the results before actually displaying it as an image.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.