The two formulations seem identical to me: $H(x) = \sum p(x) log(1/p(x))$ why would the equation be attributed to Shannon rather than Gibbs (in the context of information)?

  • $\begingroup$ Shannon's entropy is log base $2$, whereas Gibb's entropy is log base $e$ $\endgroup$ – Carlos - the Mongoose - Danger Jul 3 '16 at 20:23

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.