Skip to main content

All Questions

Filter by
Sorted by
Tagged with
16 votes
3 answers
11k views

Why is hierarchical softmax better for infrequent words, while negative sampling is better for frequent words?

I wonder why hierarchical softmax is better for infrequent words, while negative sampling is better for frequent words, in word2vec's CBOW and skip-gram models. I have read the claim on https://code....
Franck Dernoncourt's user avatar