Questions tagged [pointwise-mutual-information]

Filter by
Sorted by
Tagged with
0
votes
0answers
15 views

Finding an appropriate formula to measure mutual information between pairs of observations, with K independent features

I am currently looking for some variant of mutual information, which I can use for the following setup: I have an N (subjects) x K (features) matrix: each column (feature) follows roughly N(0,1). (...
1
vote
2answers
136 views

What is the interpretation of mutual information for events?

The mutual information is usually calculated for random variables. I don't know what it exactly measures. Events are more intuitive to me. Can we use it for events, for example, cloudy sky and rainy ...
1
vote
1answer
110 views

Simple Numeric example to understand Pointwise Mutual Information

I have been trying to find a simple numerical example for PMI in order to understand the calculations, but I have not been able to find one. I have the following data (assuming there are more data, ...
2
votes
0answers
246 views

Accuracy of PMI (Pointwise Mutual Information) calculation from co-occurrence matrix

Background When calculate PMI or PPMI from a co-occurrence matrix (COM), it sums each row (co-occurrences) of the COM e.g. 2 for pineapple as in the formula in the snapshot. For this question, it is ...