Skip to main content
4 of 4
edited tags
kjetil b halvorsen
  • 82.8k
  • 32
  • 201
  • 663

What is the role of the logarithm in Shannon's entropy?

Shannon's entropy is the negative of the sum of the probabilities of each outcome multiplied by the logarithm of probabilities for each outcome. What purpose does the logarithm serve in this equation?

An intuitive or visual answer (as opposed to a deeply mathematical answer) will be given bonus points!

histelheim
  • 3.1k
  • 6
  • 26
  • 46