2
$\begingroup$

I have read on papers that Latent Dirichlet Allocation (LDA) works by identifying word cooccurances in documents. What is confusing me is since LDA uses bag-of-words approach for document representation word cooccurance information is lost. So what does it mean by LDA works by identifying word cooccurances to form topics?

Improve this question
$\endgroup$
2
  • $\begingroup$ I think you may find some answers here (not sure if it is enough for this to count as a duplicate) stats.stackexchange.com/questions/32310/… $\endgroup$
    – Momo
    Jan 19, 2015 at 11:29
  • $\begingroup$ It uses co-occurence between documents. So given words A,B,C if one document is AB and another AC, it might therefore link B and C because they both occur with A. That it is a bag of words approach just means that document AB = BA. $\endgroup$
    – Sam Weisenthal
    Jun 7, 2017 at 23:23

1 Answer 1

Reset to default
1
$\begingroup$

Bag-of-words means that order of words is not important. Co-occurrence does not take into account the order - so there is no contradiction.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.