Skip to main content

All Questions

Filter by
Sorted by
Tagged with
1 vote
0 answers
173 views

When training word2vec, why is a new negative sampling process formulated instead of simply downsampling?

(For background, see The Skip-Gram Model.1 This question does not exactly use their notation, but you should be able to follow along.) The original skip-gram log-likelihood of a single word, $w$, ...
chicxulub's user avatar
  • 1,625