Skip to main content
improve formatting
Source Link
GeoMatt22
  • 13.1k
  • 3
  • 39
  • 72

If I am understanding the passage and table correctly, there are essentially two answers: mathematical and qualitative.

Qualitatively, the "different aspects of forecast quality" is essentially the idea of false positives vs. false negativenegatives, or precision vs. recall. (I will come back to this.)

Mathematically, the table is comparing two binary variables

$$F =\text{Was an event forecast?}\quad\text{vs.}\quad O =\text{Did an event occur?}$$

and tallying their co-occurences.

The empirical joint distribution of these variables would be $$ \begin{bmatrix} p(F,O) & p(F,\sim\!O) \\ p(\sim\!F,O) & p(\sim\!F,\sim\!O) \\ \end{bmatrix} = \frac{1}{n} \begin{bmatrix} a & b \\ c & d \\ \end{bmatrix} $$$$ \begin{bmatrix} p(\phantom{\sim}F,O) & p(\phantom{\sim}F,\sim\!O) \\ p(\sim\!F,O) & p(\sim\!F,\sim\!O) \\ \end{bmatrix} = \frac{1}{n} \begin{bmatrix} a & b \\ c & d \\ \end{bmatrix} $$ where $$\sim\!F=\text{not }F \quad,\quad \sim\!O=\text{not }O$$ and $n=a+b+c+d$.

The marginal probabilities appear in the margins of the table, and give the total probabilities for forecasts (row sums) \begin{align} p(F) &= p(F,O) + p(F,\sim\!O) = \frac{a+b}{n} \\ p(\sim\!F) &= p(\sim\!F,O) + p(\sim\!F,\sim\!O) = \frac{c+d}{n} \end{align}\begin{align} p(\phantom{\sim}F) &= p(\phantom{\sim}F,O) + p(\phantom{\sim}F,\sim\!O) = \frac{a+b}{n} \\ p(\sim\!F) &= p(\sim\!F,O) + p(\sim\!F,\sim\!O) = \frac{c+d}{n} \end{align} and observations (column sums) \begin{align} p(O) &= p(F,O) + p(\sim\!F,O) = \frac{a+c}{n} \\ p(\sim\!O) &= p(F,\sim\!O) + p(\sim\!F,\sim\!O) = \frac{b+d}{n} \\ \end{align}\begin{align} p(\phantom{\sim}O) &= p(F,\phantom{\sim}O) + p(\sim\!F,\phantom{\sim}O) = \frac{a+c}{n} \\ p(\sim\!O) &= p(F,\sim\!O) + p(\sim\!F,\sim\!O) = \frac{b+d}{n} \\ \end{align}

What is not shown in the table are the conditional probabilities. For example what is the probability of an event given that one was forecast? This is given by $$p(O\mid F)=\frac{p(F,O)}{p(F)}=\frac{a}{a+b}$$ (which could be called the precision). The complement of this would be the fraction of false alarms $p(\sim\!O|F)$$p(\sim\!O\mid F)$ (or false positives, more generally).

Another perspective would be to condition on $O$. For example the fraction of events that were forecast is given by $$p(F\mid O)=\frac{p(F,O)}{p(O)}=\frac{a}{a+c}$$ (which could be called the recall). The complement of this would be the fraction of false negatives $p(\sim\!F|O)$$p(\sim\!F\mid O)$.

Mathematically, these perspectives correspond to two different ways of factoring the joint probability $$p(O\mid F)p(F)=p(F,O)=p(F\mid O)p(O)$$$$p(O\mid F)\,p(F)=p(F,O)=p(F\mid O)\,p(O)$$

(Due to this, a punny personality such as myself might describe the joint probability as the "missing link" in Bayes theorem!)

If I am understanding the passage and table correctly, there are essentially two answers: mathematical and qualitative.

Qualitatively, the "different aspects of forecast quality" is essentially the idea of false positives vs. false negative, or precision vs. recall. (I will come back to this.)

Mathematically, the table is comparing two binary variables

$$F =\text{Was an event forecast?}\quad\text{vs.}\quad O =\text{Did an event occur?}$$

and tallying their co-occurences.

The empirical joint distribution of these variables would be $$ \begin{bmatrix} p(F,O) & p(F,\sim\!O) \\ p(\sim\!F,O) & p(\sim\!F,\sim\!O) \\ \end{bmatrix} = \frac{1}{n} \begin{bmatrix} a & b \\ c & d \\ \end{bmatrix} $$ where $$\sim\!F=\text{not }F \quad,\quad \sim\!O=\text{not }O$$ and $n=a+b+c+d$.

The marginal probabilities appear in the margins of the table, and give the total probabilities for forecasts (row sums) \begin{align} p(F) &= p(F,O) + p(F,\sim\!O) = \frac{a+b}{n} \\ p(\sim\!F) &= p(\sim\!F,O) + p(\sim\!F,\sim\!O) = \frac{c+d}{n} \end{align} and observations (column sums) \begin{align} p(O) &= p(F,O) + p(\sim\!F,O) = \frac{a+c}{n} \\ p(\sim\!O) &= p(F,\sim\!O) + p(\sim\!F,\sim\!O) = \frac{b+d}{n} \\ \end{align}

What is not shown in the table are the conditional probabilities. For example what is the probability of an event given that one was forecast? This is given by $$p(O\mid F)=\frac{p(F,O)}{p(F)}=\frac{a}{a+b}$$ (which could be called the precision). The complement of this would be the fraction of false alarms $p(\sim\!O|F)$ (or false positives, more generally).

Another perspective would be to condition on $O$. For example the fraction of events that were forecast is given by $$p(F\mid O)=\frac{p(F,O)}{p(O)}=\frac{a}{a+c}$$ (which could be called the recall). The complement of this would be the fraction of false negatives $p(\sim\!F|O)$.

Mathematically, these perspectives correspond to two different ways of factoring the joint probability $$p(O\mid F)p(F)=p(F,O)=p(F\mid O)p(O)$$

(Due to this, a punny personality such as myself might describe the joint probability as the "missing link" in Bayes theorem!)

If I am understanding the passage and table correctly, there are essentially two answers: mathematical and qualitative.

Qualitatively, the "different aspects of forecast quality" is essentially the idea of false positives vs. false negatives, or precision vs. recall. (I will come back to this.)

Mathematically, the table is comparing two binary variables

$$F =\text{Was an event forecast?}\quad\text{vs.}\quad O =\text{Did an event occur?}$$

and tallying their co-occurences.

The empirical joint distribution of these variables would be $$ \begin{bmatrix} p(\phantom{\sim}F,O) & p(\phantom{\sim}F,\sim\!O) \\ p(\sim\!F,O) & p(\sim\!F,\sim\!O) \\ \end{bmatrix} = \frac{1}{n} \begin{bmatrix} a & b \\ c & d \\ \end{bmatrix} $$ where $$\sim\!F=\text{not }F \quad,\quad \sim\!O=\text{not }O$$ and $n=a+b+c+d$.

The marginal probabilities appear in the margins of the table, and give the total probabilities for forecasts (row sums) \begin{align} p(\phantom{\sim}F) &= p(\phantom{\sim}F,O) + p(\phantom{\sim}F,\sim\!O) = \frac{a+b}{n} \\ p(\sim\!F) &= p(\sim\!F,O) + p(\sim\!F,\sim\!O) = \frac{c+d}{n} \end{align} and observations (column sums) \begin{align} p(\phantom{\sim}O) &= p(F,\phantom{\sim}O) + p(\sim\!F,\phantom{\sim}O) = \frac{a+c}{n} \\ p(\sim\!O) &= p(F,\sim\!O) + p(\sim\!F,\sim\!O) = \frac{b+d}{n} \\ \end{align}

What is not shown in the table are the conditional probabilities. For example what is the probability of an event given that one was forecast? This is given by $$p(O\mid F)=\frac{p(F,O)}{p(F)}=\frac{a}{a+b}$$ (which could be called the precision). The complement of this would be the fraction of false alarms $p(\sim\!O\mid F)$ (or false positives, more generally).

Another perspective would be to condition on $O$. For example the fraction of events that were forecast is given by $$p(F\mid O)=\frac{p(F,O)}{p(O)}=\frac{a}{a+c}$$ (which could be called the recall). The complement of this would be the fraction of false negatives $p(\sim\!F\mid O)$.

Mathematically, these perspectives correspond to two different ways of factoring the joint probability $$p(O\mid F)\,p(F)=p(F,O)=p(F\mid O)\,p(O)$$

(Due to this, a punny personality such as myself might describe the joint probability as the "missing link" in Bayes theorem!)

Source Link
GeoMatt22
  • 13.1k
  • 3
  • 39
  • 72

If I am understanding the passage and table correctly, there are essentially two answers: mathematical and qualitative.

Qualitatively, the "different aspects of forecast quality" is essentially the idea of false positives vs. false negative, or precision vs. recall. (I will come back to this.)

Mathematically, the table is comparing two binary variables

$$F =\text{Was an event forecast?}\quad\text{vs.}\quad O =\text{Did an event occur?}$$

and tallying their co-occurences.

The empirical joint distribution of these variables would be $$ \begin{bmatrix} p(F,O) & p(F,\sim\!O) \\ p(\sim\!F,O) & p(\sim\!F,\sim\!O) \\ \end{bmatrix} = \frac{1}{n} \begin{bmatrix} a & b \\ c & d \\ \end{bmatrix} $$ where $$\sim\!F=\text{not }F \quad,\quad \sim\!O=\text{not }O$$ and $n=a+b+c+d$.

The marginal probabilities appear in the margins of the table, and give the total probabilities for forecasts (row sums) \begin{align} p(F) &= p(F,O) + p(F,\sim\!O) = \frac{a+b}{n} \\ p(\sim\!F) &= p(\sim\!F,O) + p(\sim\!F,\sim\!O) = \frac{c+d}{n} \end{align} and observations (column sums) \begin{align} p(O) &= p(F,O) + p(\sim\!F,O) = \frac{a+c}{n} \\ p(\sim\!O) &= p(F,\sim\!O) + p(\sim\!F,\sim\!O) = \frac{b+d}{n} \\ \end{align}

What is not shown in the table are the conditional probabilities. For example what is the probability of an event given that one was forecast? This is given by $$p(O\mid F)=\frac{p(F,O)}{p(F)}=\frac{a}{a+b}$$ (which could be called the precision). The complement of this would be the fraction of false alarms $p(\sim\!O|F)$ (or false positives, more generally).

Another perspective would be to condition on $O$. For example the fraction of events that were forecast is given by $$p(F\mid O)=\frac{p(F,O)}{p(O)}=\frac{a}{a+c}$$ (which could be called the recall). The complement of this would be the fraction of false negatives $p(\sim\!F|O)$.

Mathematically, these perspectives correspond to two different ways of factoring the joint probability $$p(O\mid F)p(F)=p(F,O)=p(F\mid O)p(O)$$

(Due to this, a punny personality such as myself might describe the joint probability as the "missing link" in Bayes theorem!)