2
$\begingroup$

So I am trying to do pretraining on MIDI (music input) of humans using recurrent neural networks. I read the papers https://arxiv.org/pdf/1412.6581v6.pdf and http://www.hexahedria.com/2015/08/03/composing-music-with-recurrent-neural-networks/ And this video https://www.youtube.com/watch?v=cu1_uJ9qkHA

but I am not sure I am understand the structure of the nets (it is not well defined in the papers, especially in a case when I am merging two of them).

Questions

  • How should I combine a convolutional neural network and a recurrent neural network? What should be the proper intuition for do so?
  • Can I use a guassian mixture model as a decoder alongside variational recurrent autoencoder?
  • Can any one point me to a url/paper which has detailed the architecture of such a variational recurrent auto encoder to do pre training on MIDI?
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.