A topic model is a type of statistical model for discovering the abstract "topics" that occur in a collection of documents.

learn more… | top users | synonyms

0
votes
0answers
14 views

Can doc2vec or word2vec used for (un/semi - supervised) topic modeling?

Sampling methods used in these methods are different from simple bag of words. They are usually suitable for supervised learning. Can one or both of these models be extended for unsupervised or ...
0
votes
1answer
19 views

What topic model should I use? [on hold]

I want to find out what is the most hot topic which twitter users are speaking about "Cancer". I have downloaded 10000 medical articles abstracts for training and 20000 tweets for test. What topic ...
0
votes
0answers
28 views

Latent Dirichlet Allocation yields different posterior distribution than simple Bayesian model

Method A: out of the box LDA I am using a package to run LDA on a sample of size m with n words in the vocabulary. The end ...
1
vote
1answer
14 views

predict upvotes a review would get in a certain time period after publishing--yelp review

I've encountered this question online. How to design an algorithm to predict how many upvotes a review would get in a certain time period after publishing. Let's say the review comes from Yelp. So the ...
1
vote
1answer
53 views

How to optimize the number of topics using R Mallet

I would like to select the optimal number of LDA topics using R's mallet library. I know that there are several ways to do this using other implementations of LDA ...
2
votes
1answer
35 views

Benefits of clustering algorithms and Latent Dirichlet Allocation / topic models for finding clusters of words / topics in text

I am interested in finding clusters of words / topics in text. I am trying to learn more about potential approaches. The Wikipedia page on document clustering seems to provide a helpful overview ...
0
votes
0answers
16 views

Limitation of LDA (latent dirichlet allocation)

I'd like to get a list of limitations of LDA. I know that LDA does not work for short document set like a set of tweets very well. Are there such known limitations of LDA? Some reference including a ...
1
vote
1answer
29 views

About LDA model, I need a true expert to tell me that what is the real benefits of the Dirichlet prior? [closed]

Well,you know ,the only difference between pLSI and LDA is that the latter has a Dirichlet prior,thus the number of model parameters do not increase with the size of corpus,and this avoid the ...
1
vote
1answer
33 views

Neural network to tag multiple textual topics in a single document

I want to use a neural network to do some topic analysis in a textual corpus. I have used neural networks before where there is a clear decision boundary between the category to which some observation ...
1
vote
1answer
33 views

Can topic model be used to classify documents ?

Is dynamic topic model can be used to label data ? I divided a unlabeled dataset into training and testing sets. Is it rational to label the training data with dynamic topic model (I want to take time ...
0
votes
0answers
28 views

How Perplexity measured effectiveness of topic modeling?

I am confusing about Perplexity, who can explain me How Perplexity measured effectiveness of Topic modeling by an example? (perceptible and easy to understand) for example suppose we have phi and ...
0
votes
1answer
79 views

topic similarity semantic PMI between two words wikipedia

I am trying to compute pointwise mutual information (PMI) using wikipedia as data source. Given two words, PMI defines the relation between two words. The formula is as below. ...
2
votes
3answers
54 views

Data set for document topic discovery

I have a bunch of documents and would like to to assign one (or more) topics to each document. The topics can be quite wide ranging from political topics to sports, etc. I think the best way is to ...
0
votes
0answers
19 views

Diagnostics for Gibbs sampler in R package topicmodels

I'm experimenting with topic models for my master thesis. I have a dataset consisting of about 300 variables representing words and 900 cases. It's not in document form, because I pre-selected certain ...
0
votes
1answer
92 views

Interpreting the result of topic modelling using Latent Dirichlet Allocation

I have an unpublished corpus consisting of 135 texts representing one year each. I do topic modelling (using Mallet) and then inspect the topic distribution over time. The overall picture looks good: ...
1
vote
0answers
67 views

Latent Dirichlet Allocation example in PyMC doesn't seem to give correct results

I've been working on the PyMC example for Latent Dirichlet Allocation (LDA) in this other post. The problem is that it doesn't seem to actually find the correct topics. For the code below my ...
1
vote
1answer
45 views

Does one need to adjust for document length (in terms of pages) in topic modeling?

I am thinking about whether one needs to normalize or weight a topic model by document length (page length)? I am estimating a topic model using social science (JSTOR) articles, where they vary in ...
1
vote
1answer
37 views

Running Latent Dirichlet Allocation (LDA) on word counts

I have difficulties understanding the VB implementation lda-c. In particular, the method expects as input a bag-of-words representation of documents, where distinct words appearing in a document are ...
0
votes
2answers
49 views

Evaluation of LDA

I am looking for a C++/Java implementation for computing the perplexity of held-out document in Latent Dirichlet allocation. Can anybody suggest useful links?
1
vote
1answer
199 views

Implement a Bigram Latent Dirichlet Allocation (LDA) for Topic Modeling

I'm trying to implement Latent Dirichlet Allocation (LDA) on a bigram language model. This is described in Topic Modeling: Beyond Bag-of-Words by Hanna Wallach et al. I'm trying to easily implement ...
0
votes
0answers
29 views

advice regarding which ant clustering algorithm to choose

I am working on this project in which I am going to take a small corpora of input text consisting of works of literature from different genre. After extracting a set of features, I wish to perform ...
0
votes
0answers
64 views

EM to Variational EM in LDA

Why exactly, when learning hidden variables distribution in LDA(Latent Dirichlet Allocation), one cannot use to the EM (Expectation Maximization) algorithm and have to resort to a variationnal EM ...
0
votes
0answers
57 views

Incorporating metadata to a supervised Topic Model

I have texts and their metadata and a response variable (how many times the text has been read). I'm interesting in finding out how the latent topics in the set of texts are related to the popularity ...
0
votes
0answers
172 views

vowpal wabbit LDA

I am trying to use vowpal wabbit to do LDA on a corpus. I am running into a few issues regarding the output. To test it, I was using a file with just 3 lines (3 documents as per the VW input format) ...
1
vote
1answer
149 views

Is this a correct way to do document classification using topic modeling?

I am using LDA to extract topics. I want to do topic modelling and use the topics as features to do document classification. I am proposing the below approaches using scikit-learn. I want to know ...
4
votes
1answer
151 views

What does it mean to say that “a topic is a distribution on words”?

I was taking a machine learning course and they say the following two phrases that confuse me: each document is a distribution on topics. and each topic is a distribution on words. I was ...
0
votes
0answers
92 views

Can a labeled LDA (Latent Dirichlet Allocation) dataset have just one label per document?

I understand that in labeled LDA, every document should be associated with a set of labels which are known as tagged topics for the respective document. My question is whether a document can be ...
0
votes
0answers
49 views

Are there Relational Topic Model implementations available anywhere other than {lda} Gibbs Sampler?

Reading the help of CrossValidated about wether or not this question would belong here and StackOverflow it says "if it needs statistical expertise to understand or answer, ask it here". Since this is ...
0
votes
0answers
136 views

Latent Semantic Analysis with automatically discovered priors - gensim

I have around 20,000 English words in a set, mostly nouns. Something like {berry,bloom,buddy,comic,front,mind,charlie,consultants,destination,enterprise,experts,lady,stores,weight,arms,autism,balloon} ...
0
votes
1answer
105 views

Hierarchical Dirichlet Processes in topic modeling

I think I understand the main ideas of hierarchical dirichlet processes, but I don't understand the specifics of its application in topic modeling. Basically, the idea is that we have the following ...
1
vote
0answers
38 views

(LDA) Topic Modeling: eliminate Junktopics through normalization

Question: Is it reasonable to normalize topics to eliminate junk-topics and get a better distinction of document-relations? I used the MALLET-LDA Java-library to estimate a ParallelTopicModel with ...
0
votes
0answers
117 views

Correlated topic models in the lda R package

Can someone either explain to me or link to documentation which explains how to use correlated topic models in the lda package for R, the official documentation ...
1
vote
0answers
21 views

Topic Model inference for subselection

Question: Does the inference of a trained topic model (LDA) used on a subselection of a text corpus result in more accurate document-document-relations? I used the MALLET-LDA Java-library to estimate ...
1
vote
0answers
51 views

Topic models (LDA), word cooccurances in documents?

I have read on papers that Latent Dirichlet Allocation (LDA) works by identifying word cooccurances in documents. What is confusing me is since LDA uses bag-of-words approach for document ...
1
vote
0answers
64 views

Gibbs sampling version for estimating the Dynamic Topic Model (DTM)?

The paper of Blei et Lafferty published at ICML'06 implements a (quite complicated) variational inference (VI) technique for estimating the parameters of the Dynamic Topic Model, see: ...
0
votes
1answer
113 views

A single document as input to LDA?

We use topic modelling usually on a collection of documents - which makes the input. But what if I only have a single document where I want to see the underlying topics in it? I have heard that you ...
0
votes
0answers
30 views

Descriptive clustering of papers

Given a set of PubMed abstracts or keywords derived from MeSH terms, I would like to know how many and what topics are among them in order to write a paper review. Other information such as the number ...
0
votes
0answers
15 views

Automatically generated topics‏

What is difference between the extention of LDA (Dependency -LDA) in : http://psiexp.ss.uci.edu/research/papers/RubinEtAl_2011_MLJ_SpecialIssue_2ndResubmission_V14p1.pdf and the CoL Model(Correlated ...
0
votes
1answer
59 views

Topics in Latent Dirichlet allocation

I understand that an Latent Dirichlet allocation models each document as a mixture of topics where a topic is a distribution over words. What is not clear to me whether I need to manually specify ...
1
vote
0answers
196 views

Converting numbers in linear space to binary using sigmoid in R

I'm running a binary prediction using a supervised topic modeling package in R (lda package, using slda.predict function). The ...
0
votes
1answer
219 views

How do you estimate $\alpha$ parameter of a latent dirichlet allocation model?

Blei has shown that it is possible to estimate $\alpha$ in a LDA model, but I have yet to find a library (any library; C, C++, Java, ...) to do so. Usually, implementations (including Blei's) treat ...
0
votes
1answer
55 views

Can dummy variables be used to represent space in latent Dirichlet allocation?

Can dummy variables be used to represent space in latent Dirichlet allocation? I have a set of geocoded textual documents. I would like to use LDA to generate a topic model for the documents. ...
3
votes
1answer
134 views

In LDA, how to interpret the meaning of topics?

I am studying Latent Dirichlet Allocation (LDA) model, and I found some explanations around the web (for example here on Quora.com). In the link examples, I can clearly see which are the topics author ...
0
votes
0answers
21 views

plsa using maximum a posteriori

I have performed topic modeling by PLSA using maximum likelihood estimation. Now I need to perform using maximum a posteriori by using some prior distribution. The prior distribution consists of word ...
2
votes
1answer
736 views

Using topic words generated by LDA to represent a document

I want to do document classification by representing each document as a set of features. I know that there are many ways: BOW, TFIDF, ... I want to use Latent Dirichlet Allocation (LDA) to extract ...
1
vote
0answers
89 views

Practical Implementation of Gibbs Sampling in Latent Diriclet Allocation

In the collapsed Gibbs sampling version of LDA, the posterior distribution of topic assignments for each word is sampled. From what I have read (e.g. ...
1
vote
1answer
492 views

Comparing topic distributions between corpora using Latent Dirichlet Allocation and R topicmodels or python gensim

So I am working on a problem where I want to extract a set of LDA topics from one corpus, and then compare the distribution of those topics in other corpora. So basically I want to lock-in the topics ...
2
votes
1answer
138 views

Basic Question about the Latent Dirichlet Allocation Generative Model

So Here is the LDA Generative Model The $\alpha$ and $\beta$ nodes represent the parameters for two Dirichlet distributions. The $\theta$ and $\phi$ nodes represent the parameters for two ...
0
votes
0answers
56 views

A question about Latent Dirichlet Allocation model

when I used LDA model in my project, the result topic terms vary with the random seed. how to solve this problem ? thanks
1
vote
1answer
296 views

understanding of effect of $\alpha$ in Dirichlet distribution

When reading the topic modeling tutorial written by Blei, KDD 2011 tutorial I was confused about a set of diagrams which aim to show the effect of $\alpha$ in Dirichlet distribution. For example, for ...