2
$\begingroup$

I have read on papers that Latent Dirichlet Allocation (LDA) works by identifying word cooccurances in documents. What is confusing me is since LDA uses bag-of-words approach for document representation word cooccurance information is lost. So what does it mean by LDA works by identifying word cooccurances to form topics?

$\endgroup$
  • $\begingroup$ I think you may find some answers here (not sure if it is enough for this to count as a duplicate) stats.stackexchange.com/questions/32310/… $\endgroup$ – Momo Jan 19 '15 at 11:29
  • $\begingroup$ It uses co-occurence between documents. So given words A,B,C if one document is AB and another AC, it might therefore link B and C because they both occur with A. That it is a bag of words approach just means that document AB = BA. $\endgroup$ – user0 Jun 7 '17 at 23:23
1
$\begingroup$

Bag-of-words means that order of words is not important. Co-occurrence does not take into account the order - so there is no contradiction.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.