Search Results
| Search type | Search syntax |
|---|---|
| Tags | [tag] |
| Exact | "words here" |
| Author |
user:1234 user:me (yours) |
| Score |
score:3 (3+) score:0 (none) |
| Answers |
answers:3 (3+) answers:0 (none) isaccepted:yes hasaccepted:no inquestion:1234 |
| Views | views:250 |
| Code | code:"if (foo != bar)" |
| Sections |
title:apples body:"apples oranges" |
| URL | url:"*.example.com" |
| Saves | in:saves |
| Status |
closed:yes duplicate:no migrated:no wiki:no |
| Types |
is:question is:answer |
| Exclude |
-[tag] -apples |
| For more details on advanced search visit our help page | |
Results tagged with backpropagation
Search options not deleted
user 191675
Backpropagation, an abbreviation for "backward propagation of errors", is a common method of training artificial neural networks used in conjunction with an optimization method such as gradient descent.
2
votes
Backpropagation with Softmax / Cross Entropy
However writing this out for those who have come here for the general question of Backpropagation with Softmax and Cross-Entropy.
$$
\mathbf {
\bbox[10px, border:2px solid red] { \color{red}{
\begin{aligned …
- 241
1
vote
Jacobian Matrix of an Element wise operation on a Matrix
Adding the answer as per the explanation by @whuber
$$
\begin{aligned}
\text{Let's take a 2x2 matrix , X } =
\begin{bmatrix}
x_{{1}{1}} & x_{{1}{2}} \\
x_{{2}{1}} & …
- 241
0
votes
1
answer
1k
views
Jacobian Matrix of an Element wise operation on a Matrix
Is it right in saying that the Jacobian Matrix of a Matrix output of an elementwise operation to the same input is a diagonal matrix ?
Context below.
From ref 1 it is clear that when you have an eleme …
- 241
0
votes
1
answer
206
views
Back Propagation Derivation - where am I going wrong
The main thing is that I tried to derive out backpropagation via chain rule etc. … I tried to implement a simple CNN to test this out; however, during backpropagation, the weights are not matching. Even when I try to do Hadamard product (element-wise multiplication). …
- 241
0
votes
Accepted
Back Propagation Derivation - where am I going wrong
The equations were correct. I had done a mistake in the code ; there were some element wise operations and some dot product type operations. It is corrected now - code
print("-----------Back Propog …
- 241