In regards to this paper, arXiv:1611.01578 [cs.LG] the very last image, seen below, has a graph of a LSTM Cell (top left). I am trying to recreate it in python, but main thing that throwing me off.
Why are input and hidden state added in this diagram? Everywhere I see an LSTM diagram, the input and hidden state are concatenated, multiplied with a weight, and then bias is added. This matrix is then split into gates, and Each gate undergoes operations and you end up with hidden state and cell state.