I'm working on a research project where we are trying to assess model fit improvement of our LDA model (the basic Blie et al., 2003 LDA approach (pdf)). I'm looking for code that allows us to assess the perplexity of our LDA model as we tune it.

I know the R Package topicmodels (Journal of Statistics Software paper for package) has a perplexity function but my PI wants other options outside of R. Any recommendations?

  • $\begingroup$ welcome to the site. Can you provide full links to (i) the paper, (ii) the R package, please? $\endgroup$
    – StasK
    Commented Feb 12, 2013 at 17:39
  • $\begingroup$ StasK, Certainly, see below. Links to papers - LDA: cs.princeton.edu/~blei/papers/BleiNgJordan2003.pdf R Package: topicmodels - R Package description: cran.r-project.org/web/packages/topicmodels/topicmodels.pdf - Journal of Statistics Software paper: jstatsoft.org/v40/i13/paper $\endgroup$
    – R_Queery
    Commented Feb 13, 2013 at 19:43
  • $\begingroup$ Uhm... I rather wanted you to edit your original question and include links there, so that other folks would not have to dig into the comments. (This is not your typical forum, you can go back and edit your questions. In fact, I can edit it, too, but it would be better if you did.) $\endgroup$
    – StasK
    Commented Feb 14, 2013 at 20:57


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Browse other questions tagged or ask your own question.