Sorry if this question is too stupid... Why in general do we care about expected value (integrating outcomes over a probability distribution)? Here is a scenario that illustrates my confusion:
Suppose we are forced to participate in the following game:
We roll a 6-sided dice in a completely dark room, so we can't see the number. One number is showing face up and we can't touch the dice after rolling it. We are given two options and our objective is to live.
Option 1: If the number is 1 or 2, we die, otherwise we live.
Option 2: If the number is 3,4,5 or 6 we die, otherwise we live.
It seems obvious that option 1 is the better choice because there is a lower "probability" that we die compared to option 2. But I'm having some trouble articulating a rigorous/clear argument for why it's "better" ?
Argument 1: Assuming we have a uniform prior on what number the dice could be showing, option 1 gives us a higher probability of survival. Define U_i to be a universe in which the dice has rolled i. By choosing option 1, you survive in universes U_3,U_4,U_5,U_6. Since you are equally likely to be in each universe, you should go with option 1.
Response: What is the precise meaning of this "probability" and how does it connect to our goal (surviving)? What does it mean to be "equally likely" and why "should" I maximize the "likely"-weighted number of universes I survive in when I am in one particular universe?
Argument 2: If this game were repeated multiple times, you would die fewer times if you chose option 1 every time.
Response: Why do I care about this if I'm only playing the game once?