Skip to main content

All Questions

Filter by
Sorted by
Tagged with
1 vote
1 answer
340 views

Feedforward Neural Net Language Model - computational complexity (word2vec)

While reading this paper on word2vec, I came around the following description of a feedforward Neural Net Language model (NNLM): It consists of input, projection, hidden and output layers. At the ...
MDescamps's user avatar
1 vote
1 answer
312 views

Skip-gram model multiplicative constant in the objective function?

I was reading this paper (https://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf) I cannot understand where does the multiplicative constant $...
alienflow's user avatar
  • 271
2 votes
1 answer
937 views

Why two layers of matrix multiplication is needed in CBOW and Skip-gram model?

I found a nice tutorial here regarding CBOW and Skip-gram models for Word2Vec. I got the following doubt: Why two layers of matrix multiplication is need for CBOW and SKIP-GRAM ? As multiplying a ...
aroyc's user avatar
  • 153