Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 291450

A mathematical quantity designed to measure the amount of randomness of a random variable.

0 votes

What is the significance of the log base being 2 in entropy?

But if you wanted to go deeper, have a look at Information Theory - Rationale Behind Using Logarithm for Entropy, and Other Explanations. …
manisar's user avatar
0 votes

What is the role of the logarithm in Shannon's entropy?

This is just verbiage for the Entropy equation: $$\begin{align} H = & \sum_i{p_i.i} \\[6pt] = & - \sum_i{p_i \log_2({p_i}}) \end{align}$$ The above has been explained in more detail here. …
manisar's user avatar