Timeline for Causal inference where potential outcome is somehow "violated"?
Current License: CC BY-SA 4.0
9 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Dec 13, 2021 at 22:25 | comment | added | mribeirodantas | Sure. The comment I upvoted seems to be the right approach. | |
| Dec 13, 2021 at 22:18 | comment | added | Ryan | Let us continue this discussion in chat. | |
| Dec 13, 2021 at 22:14 | comment | added | Ryan | Yes I am not giving the same ad (with and without image) to the same user. A user can only see one version. I am assuming the two group of users follow the same distribution. In addition I don't care about what happen at per user level. We care about the total click accumulated during the whole period of experiment. I think one potential workaround is to treat an ad as two, one only sees the control flow and one only sees the treatment flow. | |
| Dec 13, 2021 at 21:36 | comment | added | mribeirodantas | Continuing the comment, sorry for it being so long. It's a fundamental problem of causal inference because you can not observe how Bob behaved, for each of the ads (with/out image). You can only observe with one. | |
| Dec 13, 2021 at 21:34 | comment | added | mribeirodantas | Let's say that the ads are the units, as you're saying. Can you show, at the same time, to the same individual, the same ad WITH and WITHOUT the image separately? No. The best you can do is to show both at the same time, or one after the other, which is not the same thing. If you give two drugs to a lot of people, and they get better, this does not help you find out which drug, A or B, contributed to what you saw. The ideal way would be to give the ad without image, measure what happened. Then you travel back in time, and show the ad with the image, making sure nothing else changed. | |
| Dec 13, 2021 at 21:29 | comment | added | Ryan | i think whichever metric I am looking won't make a lot of difference? let's say I am looking at number of clicks | |
| Dec 13, 2021 at 21:27 | comment | added | mribeirodantas | How are you measuring the benefit? More clicks on the ads with images when compared to the ads without it? More purchases after clicking on the ad with/out images? | |
| Dec 13, 2021 at 21:21 | comment | added | Ryan | In my A/B test framework, I am applying the intervention(i.e. adding an images) to the ads and trying to see its effect. In this sense the ads are the units of the experiment. In this case, how can I answer question like "which group of ads will benefit the most from the addition of images?" | |
| Dec 13, 2021 at 20:48 | history | answered | mribeirodantas | CC BY-SA 4.0 |