All Questions
Tagged with language-models word2vec
3 questions
1
vote
1
answer
340
views
Feedforward Neural Net Language Model - computational complexity (word2vec)
While reading this paper on word2vec, I came around the following description of a feedforward Neural Net Language model (NNLM):
It consists of input, projection, hidden and output layers. At the ...
1
vote
1
answer
312
views
Skip-gram model multiplicative constant in the objective function?
I was reading this paper (https://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf) I cannot understand where does the multiplicative constant $...
2
votes
1
answer
937
views
Why two layers of matrix multiplication is needed in CBOW and Skip-gram model?
I found a nice tutorial here regarding CBOW and Skip-gram models for Word2Vec. I got the following doubt:
Why two layers of matrix multiplication is need for CBOW and SKIP-GRAM ? As multiplying a ...