Ahmad
  • Member for 5 years, 5 months
  • Last seen this week
  • Iran
3 answers
4 votes
215 views
If $P(x \mid y)$ is high, then does this imply that $P(y \mid x)$ is also high?
Accepted answer
2 votes

Let's review the conditional probability of both $P(x|y)$ and $P(y|x)$: $$P(x|y) = \frac{P(x \cap y)}{P(y)}$$ and $$P(y|x) = \frac{P(x \cap y)}{P(x)}$$ The common thing in both is their joint ...

View answer
12 answers
601 votes
421k views
What is the difference between "likelihood" and "probability"?
1 votes

If we put the conditional probability interpretation aside, you can think it in this way: In probability you usually want to find the probability of a possible event based on a model/parameter/...

View answer
2 answers
1 votes
139 views
What is the interpretation of mutual information for events?
0 votes

Mutual information is linked to the concept of entropy of a random variable that quantifies the expected "amount of information" held in a random variable, or the amount of uncertainty about ...

View answer
2 answers
3 votes
71 views
Can two events be strongly or weakly dependent?
0 votes

Pointwsei mutual information is a measure of association between two single events. $$\operatorname{pmi}(x;y) \equiv \log\frac{p(x,y)}{p(x)p(y)} = \log\frac{p(x|y)}{p(x)} = \log\frac{p(y|x)}{p(y)}$$ ...

View answer
3 answers
13 votes
12k views
VC dimension of a rectangle
0 votes

Consider it like a game between you and an opponent. You choose the location of points and the opponent label them anyway he likes. If he wins by finding a labeling that can not be shattered, then ...

View answer