In the book 'Causal Inference in Statistics A Primer' By Pearl et al. there is an example towards the end, (Ex 4.5.1 page 119) that calculates the probability of necessity PN = 1, and the authors state 'The data provides us with 100% assurance that drug x was in fact responsible for the death of Mr. A'

This is a beginner book on the topic, so I'm no expert but this example is raising a lot of red flags for me. I would appreciate some clarification as to how results makes logical sense. At the moment I'm convinced there are multiple errors being made.

Here are my points of contention:

• Stating an event is 100% responsible for anything does not seem realistic. Shouldn't it at max approach 100%?
• If the example data had a single death in the controlled experiment shifted from do(x') to do(x), the formula yields a PN of 200%. If interpreted similarly to the given example, this would be a "200% assurance that the drug was responsible for the death of Mr. A." This outcome seems meaningless as there can not be a 200% probability of something occurring.
• What justifies assuming the two groups came from similar populations.

To keep my post length down, I'll stop with those questions for now.

The author seems to have intended the result to be counter intuitive, and yet all he did was plug in numbers to the formula and present a counter intuitive result without further explanation. Without justification, I have not been able to reconcile the example and am now doubting the correctness of the equations.

Here is the example:

Example 4.5.1 (Attribution in Legal Setting) A lawsuit is filed against the manufacturer of a drug x. charging that the drug is likely to have caused the death of Mr. A, who took it to relieve back pains. The manufacture claims that experimental data on patients with back pains show conclusively that drug x has only minor effects on death rates. However, the plaintiff argues that the experimental study is of little relevance to this case because it represents average effects on patients in the study, not on patients like Mr A who did not participate in the study. In Particular argues the plaintiff, MR. A is unique in that he used the drug of his own volition, unlike subjects in the experimental study who took the drug to comply with the experimental protocols. To support this argument, the plaintiff furnishes non-experimental data on patients who like Mr A, chose drug x to relieve back paints but were not part of any experiment and who experience lower death rates that those who didn't take the drug [How does one have data on patients who didn't take the drug from a sample of those who chose to take the drug?]. The court must now decide based on both the experimental and non-experimental studies whether it is "more probably than not" that drug x was in fact the cause of Mr A's death.

The experimental data provide the estimates

P(y|do(x)) = 0.016
P(y|do(x')) = 0.014

whereas the non-experimental data provide the estimates

P(y) = 30/2000 = 0.015
P(x,y) = 2/2000 = 0.002
P(y|x) = 2/1000 = 0.002
P(y|x') = 28/2000 = 0.028

Data:

               Experimental     NonExper.
                do(x)   do(x')  x      x'  
Deaths(y)        16     14      2     28
Survivals(y')   984     986     998   972

Assuming that drug can only cause but not prevent death, monotonicity holds and therm 4.5.1 yields:

$PN = \frac{P(y|x) - P(y|x')}{P(y|x)} + \frac{P(y|x') - P(y|do(x'))}{P(x,y)}$

$PN = \frac{0.002 - 0.028}{0.002} + \frac{0.028 - 0.014}{0.001} = -13 + 14 = 1$

We see that while the observation ERR is negative (-13) giving the impression that the drug is actually preventing deaths , the bias-correction term (+14) rectifies this impression and set the probability of necessity (PN) to unity. Moreover, since the lower bound of Eq. 4.30 [Not shown by me] becomes 1, we conclude that PN=1.00 even without assuming monotonicity. Thus the plaintiff was correct, barring sampling errors, the data provide us with 100% assurance that drug x was in fact responsible fro the death of Mr. A.

Please help me understand how a result can be "100% assurance" and how the equation makes sense given that if the example experimental data had been shifted by one as shown below:

               Experimental     NonExper.
                do(x)   do(x')  x      x'  
Deaths(y)        17     13      2     28
Survivals(y')   984     986     998   972

Then the result would have been:

$PN = \frac{0.002 - 0.028}{0.002} + \frac{0.028 - 0.013}{0.001} = -13 + 15 = 2$

Which, in the language of the author, would be a seemingly meaningless 200% assurance.

Thanks for your patience with this long post! Please help me with what I'm not understanding about the interpretation and calculation of PN in this example.