All Questions

Filter by
Sorted by
Tagged with
0
votes
0answers
44 views

Backpropagation formula for simple ANN

I'm trying to solve an exercise. I'm asked to train a 2-layer neural network, given a small dataset. Below is a picture I drew to understand the architecture and derive the formula for backpropagation....
0
votes
1answer
62 views

Backpropagation - partial derivatives

I am currently reading the Neural networks and deep learning book by Michael Nielsen. I have a question regarding the backpropagation chapter: Background: He explains the influence of a neuron on ...
1
vote
0answers
77 views

Interpretations of chain rule for backprop

In Goodfellow et al.'s Deep Learning, the authors write on page 203: Let $w \in \mathbb{R}$ be the input to the graph. We use the same function $f: \mathbb{R} \rightarrow \mathbb{R}$ as the ...
9
votes
1answer
3k views

Gradients for skipgram word2vec

I am going through the problems in the Stanford NLP deep learning class's written assignment problems http://cs224d.stanford.edu/assignment1/assignment1_soln I am trying to understand the answer for ...
1
vote
1answer
144 views

Back propagation error calculation

I'm working through AI: A Modern Approach by Russel and Norvig. At the section on back-propagation, they have this to say: The idea is that hidden node j is responsible for some fraction of the ...