Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 276940

A probability provides a quantitative description of the likely occurrence of a particular event.

2 votes
Accepted

Shannon Information | Understanding from a Microstate Perspective

,t}p_i \log_2 p_i =- (0.5 \log_2 0.5 + 0.5 \log_2 0.5) = 1\;\mathrm{bits}$$ or because each microstate is equally probable $H(X) = \log_2 2 = 1 \;\mathrm{bits}$ For the biased coin where heads has a probability
dtg67's user avatar
  • 151
1 vote

Conflicting Definition of Information in Statistics | Fisher Vs Shannon

Shannon information is related to the probability distribution of possible outcomes. … In your coin example there is little information from a probability distribution in the extreme cases, $P(X = 0)$ and $P(X = 1)$. …
dtg67's user avatar
  • 151
0 votes

Low probability of a multinomial for expected values

There are a couple reasons off of the top of my head I can think of why the probability is significantly smaller than your intuition: Playing fast and loose with rounding. …
dtg67's user avatar
  • 151