I saw a talk that mentioned this theorem. I am now trying to find details of the theorem, but I'm not having any luck. I hope that if I can describe roughly what the theorem said, someone can recognise it and point me to some literature.
So the theorem basically said something like the expected self-information of conditionalising on the value of some random variable is always higher than the prior's self-information.
Does that ring any bells?
