Timeline for Why am I getting information entropy greater than 1?
Current License: CC BY-SA 3.0
9 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jan 25, 2021 at 19:02 | answer | added | Juli | timeline score: 0 | |
| Apr 13, 2016 at 12:07 | answer | added | Nick Cox | timeline score: 24 | |
| May 5, 2014 at 14:05 | vote | accept | Akavall | ||
| May 5, 2014 at 12:45 | answer | added | CL. | timeline score: 24 | |
| Apr 26, 2014 at 23:00 | comment | added | Akavall | It seems that there is nothing wrong with entropy being greater than 1 if I have more then two events, and value of entropy is between 0 and 1 only in special case, where my events are binary (I have two events). | |
| Apr 26, 2014 at 4:23 | comment | added | Alexis | No: Shannon entropy is non-negative. | |
| Apr 26, 2014 at 3:35 | comment | added | Akavall | @Alexis, but doesn't Shannons's entropy range between 0 and 1? | |
| Apr 26, 2014 at 3:33 | comment | added | Alexis | Doesn't the base depend on the kind of entropy? Isn't base 2 Shannon entropy, and natural log statistical mechanics entropy? | |
| Apr 26, 2014 at 2:28 | history | asked | Akavall | CC BY-SA 3.0 |