Skip to main content
edited tags
Link
User1865345
  • 10.3k
  • 12
  • 23
  • 40
Tweeted twitter.com/StackStats/status/967838531946188800
Source Link
user174574
user174574

Is entropy conserved under invertible mappings?

Suppose for a random variable $ X\colon \Omega \to E $, I have an invertible mapping $ Z = f(X) $.

Is the Shannon Entropy for each variable equivalent?

$$ H(X) = H(Z) $$

If not, can anything relationship between the entropies be said in general (eg. proportionality, additive constant, etc.)?