Suppose we have several documents. These docs are classified into several categories. But there could be issues like these:
- The categories may not be properly defined.
- Or The categories are properly defined, but the docs are not properly classified.
Given the category definitions and some classified docs, I want to tell how well the situation is.
I have tried to use the probability distribution of words to describe the current status of each category. And calculate the dissimilarity of different distributions through Kullback-Leibler Divergence. But I went into some issue here: Calculate the Kullback-Leibler Divergence in practice?
I am wondering if the above way is proper. Is there a canonical way to do it?
(Pardon me if the tags I assigned are not proper.)