The following concepts are baffling and would be obliged for a constructive explanation.

(Q1) What is the conceptual difference between (a) Kolmogorov-Sinai entropy, (b) Shannon entropy, (c) Source entropy (d) topological entropy and (e) Boltzmann entropy?

(Q2) What are the relationships between different entropies?

(Q3) Are they interchangeable and mean the same?

(Q4) Where can I find a good lucid explanation about Kolmogorov entropy and why it is needed and its significance?

(Q5) Can Boltzmann entropy be equal to Kolmogorov entropy?


Shannon entropy is a general concept for entropy for any probability distribution. And depending what probability you choose, you get something different.

In particular:

And about entropies I am not deep into:

  • Kolmogorov-Sinai Entropy, is (as far I understand) a particular quantity derived from entropy, related to chaotic behavior of dynamic systems (it also happens in the phase space); as you see its formula, its formula involves Shannon entropy for a particular set related to trajectories, but also involves other operations
  • Topological entropy is a related concept

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.