1
$\begingroup$

I'm trying to replicate the algorithm found in this paper: http://arxiv.org/abs/1506.07285.

And I'm struggling to understand the notation of equation 3 on page 4, which is given as:

enter image description here

Is z(c,m,q) a matrix of the individual vectors? That wouldn't make sense, though, because the last two elements look like they would be scalars. I've read the paper and it doesn't say much about this equation. Perhaps they aren't revealing the full function and are only listing used parameters? Any ideas? The equation is used for gating in a recurrent neural network.

Edit: I understand what the individual parameters mean, but I don't understand how to define z(c,m,q), which I will need to know before I can implement equation 4.

Improve this question
$\endgroup$
3
  • $\begingroup$ What exactly do you mean by "this"? BTW, all these terms are described after equation (2) on the preceding page. $\endgroup$
    – whuber ♦
    Commented Nov 2, 2015 at 16:18
  • $\begingroup$ You seem to have accidentally created two accounts - please follow these instructions to merge them. This will make it easier for you to do things like edit your own question as you will no longer need to wait for someone to approve your edit.. $\endgroup$
    – Silverfish
    Commented Nov 2, 2015 at 17:24
  • $\begingroup$ Accounts have been merged, thanks for heads up. And thanks whuber for the request for clarification -- question has been edited. $\endgroup$
    – jstaker7
    Commented Nov 2, 2015 at 19:09

1 Answer 1

Reset to default
0
$\begingroup$

I can't find a definitive answer, but the best guess I can come up with is that it is a concatenation of the individual vectors. This line in a Keras model is what prompted this guess:

model.add(Merge([sentrnn, qrnn], mode='concat')).

I've seen similar formatting here and there in other papers, sometimes like this:

sigma([vec1,vect2], vec3).

This would work for the equations above where the inner W(1) dimension equals the sum of the dimensions of the concatenated vectors.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.