I am trying to understand how encoder-decoder models works.
The encoder receives a sequence and the length is known. However the output of the encoder is just a single word vector capturing the sentence meaning. (if I understand it correctly)
Then this single vector is passed to the decoder and it somehow manages to extract single words from it.
Does the decoder simply chose a sequence of previously defined list of sentences, the training data, or it generates the sentence on the fly?