The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
1answer
20 views

Choosing the best set of keywords

I have a dataset of tweets collected using twitter streaming API on a particular topic (say 'football') using around 40 keywords. Now if I'm going to track the same topic (football) in future how do I ...
0
votes
0answers
22 views

How do I cluster documents using topic models?

Let us say I have a topic probability per document, for example: ...
0
votes
0answers
18 views

Using LDA in non-realtime twitter data

I try to understand user characterization from twitter data. How can I understand the user's interest from statuses? From my researches, LDA(Latent Dirichlet Allocation)suitable for topic extraction. ...
1
vote
1answer
40 views

General questions regarding text-classification

I'm new to Topic Models, Classification, etc… now I'm already a while doing a project and read a lot of research papers. My dataset consists out of short messages that are human-labeled. This is what ...
0
votes
1answer
64 views

Understanding Latent Dirichlet Allocation Inference

I'm reading the wikipedia page about how Latent Dirichlet Allocation assigns a topic distribution to a document after the model's been learnt (see this link). I'm very confused by this part of it: ...
0
votes
1answer
36 views

Sparse Additive Generative Models (SAGE) v/s LDA (Latent Dirichlet Allocation)

Intuitively, how are Sparse Additive Generate Models (SAGE) by Eisenstein, different from Multinomial Dirichlet distributions. I understood that in this model distributions are added in logarithmic ...
0
votes
1answer
87 views

How to generate new Topic for new documents?

what approach would help me generate new topics for new documents? I read this page in order to learn more about the effect of specifying keywords for the topics that we care about detecting in new ...
0
votes
1answer
50 views

Gensim Topic Modeling

I want to build a standard topic classifier. I was told gensim is the way to do it. I have difficulty training the gensim system. How do we provide a training data in a fast way. Some forum suggested ...
0
votes
2answers
72 views

Is it possible for a multinomial sample to be a single number?

I'm reading the Latent Dirichlet Allocation paper trying to understand it. However I got stuck at the very first part! When they sampled from a multinomial distribution and considered the result to be ...
2
votes
0answers
142 views

Gibbs sampling for LDA — does a small Dirichlet concentration parameter make a difference?

I'm using a Gibbs sampler for Latent Dirichlet allocation as described by Griffiths and Steyvers (http://www.ncbi.nlm.nih.gov/pmc/articles/PMC387300/). The sampling of a new topic $j$ for word $i$ is ...
2
votes
1answer
94 views

At what point does LDA (Latent Dirichlet Allocation) not make sense to use?

I was wondering if anyone could provide some intuition about when the "documents" in LDA are too small for it to provide any benefit. For instance, I have seen papers where people have you used ...
0
votes
0answers
24 views

Sliding window EM algorithm for PLSA?

I'm wondering is there a version of sliding window EM? I'm working on an application involving a stream of text (tweets). We are thinking of using 1 day data as training set, and extract the topics ...
2
votes
0answers
52 views

Confusion related to correlation in topic models

I was reading this paper related to correlated topic models. However, I didn't understand this correlation figure. In the figure given below, I am confused about the level curves shown in the ...
0
votes
1answer
186 views

Topic models evaluation in Gensim

I've been experimenting with LDA topic modelling using Gensim. I couldn't seem to find any topic model evaluation facility in Gensim, which could report on the perplexity of a topic model on held-out ...
2
votes
0answers
14 views

Confusion related to intractability in topic models

I was reading this paper related to topic models. I am a bit confused why the marginal likelihood is not tractable and how converting the graphical model into the new one actually helps. First I ...
0
votes
0answers
31 views

Measure topic centrality

Does anyone know any metric that measure topic centrality or topic stickiness (I've seen someone used this term too). For example Cluster 1 $d_1$ = { a, b, c }, $d_2$ = { b, c, d } and Cluster 2 ...
0
votes
0answers
14 views

Heuristic to determine the number of latent classes [duplicate]

Do anyone know if in the field of topic modeling and latent class analysis, it exists some heuristic to determine a good number of latent classes?
2
votes
0answers
29 views

How to build event recommender based only on events' descriptions

I built a simple app that grabs events using eventbrite and meetup.com APIs and displays it based on your zip code. Now I'm trying to build a simple event recommender that will use events that you ...
5
votes
1answer
114 views

How to model the effect of “words occurring over time”?

As time goes on, some new words may occur. But standard Latent Dirichlet Allocation assume a fixed vocabulary. Is there some variation of the Latent Dirichlet Allocation model which can represent ...
0
votes
0answers
46 views

Iteration parameter in latent dirichlet allocation model

I want to find 24 topics in 800,000 documents by using LDA model, but how many iterations should I give? It is extremely slow when the parameter is large, like 3000.
0
votes
1answer
78 views

Implementing Latent Dirichlet Allocation - notation confusion

I am trying to implement LDA using the collapsed Gibbs sampler from http://www.uoguelph.ca/~wdarling/research/papers/TM.pdf the main algorithm is shown below I'm a bit confused about the notation ...
1
vote
0answers
28 views

How does word co-occurrence let two words from the same topic link together in LDA topic model?

The essence of LDA is word co-occurrence. I want to know why? and does word co-occurrence mean two words appear together in a certain document or just appear in the documents collection together? ...
1
vote
1answer
42 views

Topic modeling for grouped data

Is there a variation of Latent Dirichlet Allocation (LDA) for grouped data? As an example, let us consider corpus of all Yahoo Q&A (where for simplicity we consider a question lumped together with ...
0
votes
0answers
58 views

Posterior in latent Dirichlet analysis

I have a question regarding LDA (Latent Dirichlet Analysis) - what is the correct formulation of the posterior? In http://www.cs.princeton.edu/~blei/papers/Blei2011.pdf‎ it is $p(\beta_{1:K}, ...
0
votes
0answers
82 views

Toolkits for learning topic models from a co-occurrence matrix

I have a word-document co-occurrence matrix and would like to learn a topic model from it. Do you know any toolkits that take a matrix instead of a document collection as input?
3
votes
2answers
141 views

Is LSA and topic clustering easier in European languages similar to English?

I was watching a talk on latent semantic analysis and the speaker described experience applying LSA and REALLY messy data. He concluded that it demonstrated the difficulty of disambiguation of ...
9
votes
3answers
515 views

Topic stability in topic models

I am working on a project where I want to extract some information about the content of a series of open-ended essays. In this particular project, 148 people wrote essays about a hypothetical student ...
0
votes
0answers
198 views

Supervised Latent Dirichlet allocation (LDA) on a sentence level

I'm writing a bachelor thesis on formality classification of sentences in English via projecting the formal pronouns from foreign (e.g. French tu/vous) texts to English (you). It's not really ...
2
votes
1answer
66 views

Can LDA assign more than one topic for a word?

I have just started reading about Latent Dirichlet Allocation LDA and want to apply it to my project. May I know if LDA is able to assign a topic to more than one word? For example, Article A talks ...
1
vote
1answer
141 views

What are typical values to use for alpha and beta in Latent Dirichlet Allocation?

Specifically in the case where I don't know anything about the documents I'm working with. I'm looking a specific number or number range.
3
votes
0answers
98 views

Latent Semantic Analysis - Co-occurrence of words

Let $A[n\times m]$ represents the term-document matrix, where, $n$ is the number of terms and $m$ is the number of documents. This matrix can be composed into 3 matrices (SVD decomposition) such as, ...
0
votes
0answers
98 views

Understanding the derivation of an equation in LDA modeling

When reading the derivation of LDA models, I usually get the following equations. I do not quite understand the second step, where $p(\mathbf{z}_{-i},\mathbf{w}|\alpha,\beta)$ was removed. Is that ...
1
vote
1answer
125 views

Derivation of the posterior over topics in LDA

When studying the latent Dirichlet allocation, I am not very clear about some procedures in their deriving equations. Please refer to the attached figure, how to understand those two steps, marked as ...
-1
votes
2answers
151 views

Is classifying documents according to their topic useful for any application? [closed]

Suppose that we have digitized document images; we pass this documents through OCR and we get text text documents, that we classify according to their topics in different classes such as payroll, ...
1
vote
1answer
135 views

Latent Dirichlet analysis document comparison

I have been using Latent Dirichlet Analysis for a while but I am a bit confounded as to it's practical ability to compare two documents. It is of course ideal for classification when you want to see ...
4
votes
1answer
268 views

Variational inference for nested Chinese restaurant process

I recently read paper by Chong Wang and David M. Blei "Variational Inference for the Nested Chinese Restaurant Process". And I couldn't understand the next part (from p.5): The variational update ...
1
vote
1answer
150 views

Nonparametric Topic Models

I am confused between what types of problems these three models capture, and their applications: Latent Dirichlet Allocation (LDA) Dirichlet Processes and Pitman-Yor processes Hierarchical Dirichlet ...
0
votes
1answer
349 views

Latent Dirichlet Allocation (LDA): What exactly is inferred?

I am working my way through LDA and I think I got they main idea of it. Please correct me if I am wrong. Given the Plate notation: The variables $\alpha$ and $\beta$ are Dirichlet distribution ...
1
vote
2answers
195 views

Topic Words Selection in Topic Modeling

I understand how generative model of topic modeling works; for each topic there is a distribution of words, and for each document there is a distribution of topics. Question is how words are ...
2
votes
1answer
160 views

LDA topic models for various and unknown domains

We have a large collection (1-2M) of documents of various domains (politics, design, programming, etc.). And lets assume that we don't know the exact number of domains. And our goal is to build ...
3
votes
1answer
375 views

How to optimize hyper-parameters in LDA?

After reading Hanna Wallach's paper Rethinking LDA: Why Priors Matter, I want to add hyper-parameter optimization to my own implementation of LDA. However, the paper doesn't given any details about ...
1
vote
1answer
408 views

Topic modeling, LDA and NMF

My objective is to implement a topic model for a large number of documents (20M or 30M). Let us assume that the number of topics is fixed at 50. I think implementing an LDA for the above problem ...
3
votes
1answer
240 views

Latent Dirichlet allocation Implementation

I'm looking for some LDA implementation. I know about this one, MALLET but it is coded in Java and I need some more performant. Can someone give me some reference?
3
votes
2answers
2k views

Natural interpretation for LDA hyperparameters

Can somebody explain what is the natural interpretation for LDA hyperparameters? ALPHA and BETA are parameters of Dirichlet ...
2
votes
1answer
754 views

Trouble minimizing perplexity in LDA

I am running LDA from Mark Steyver's MATLAB Topic Modelling toolkit on a few Apache Java open source projects. I have taken care of stop word removal (for e.g. words such Apache, java keywords are ...
2
votes
1answer
385 views

LDA vs. labeled LDA

I have gone through the techniques and understood the basic ideas. But I want to know which one usually is expected to work better, LDA or Labeled LDA? What are the features of the dataset that help ...
6
votes
2answers
880 views

Supervised approaches vs. topic models in sentiment analysis

I am researching Sentiment Analysis over social media, particularly classifying online texts such as blog posts as positive, negative or neutral. Most of the approaches I have found for sentiment ...
6
votes
2answers
1k views

Topic models and word co-occurrence methods

Popular topic models like LDA usually cluster words that tend to co-occur together into the same topic (cluster). What is the main difference between such topic models, and other simple ...
6
votes
3answers
802 views

Topic models for short documents

Inspired by this question, I'm wondering whether any work has been done on topic models for large collections of extremely short texts. My intuition is that Twitter should be a natural inspiration for ...
10
votes
2answers
4k views

Two R packages for topic modeling, LDA and topicmodels?

It seems that there have two R packages for running Latent Dirichlet Allocation. One is LDA, authored by Jonathan Chang; and another is authored by Bettina Grün and Kurt Hornik. What are the ...