Suppose I am building a predictive model where I am trying to predict multiple events (for instance, both the roll of a die and the toss of a coin). Most algorithms that I am familiar with work with only one target, so I'm wondering if there is a standard approach to this sort of thing.
I see two possible options. Perhaps the most naive approach would be to simply treat them as two different problems, and then combine the results. However, that has serious drawbacks when the two targets are not independent (and in many instances they might be very dependent).
A more sensible approach to me would be to make a combined target attribute. So in the case of a die and coin, we would have $6\cdot 2=12$ states ($(1, H), (1, T), (2, H)$, etc). However, this can lead to the number of states/classes in the composite target getting rather large rather quickly (what if we had 2 dice, etc.). Furthermore, this seems strange in the case that one attribute is categorical while the other is numeric (for instance if predicting temperature and type of precipitation).
Is there any standard approach to this sort of thing? Alternatively, are there any learning algorithms designed specifically to handle this?
