Skip to main content
Cross Validated

Return to Question

added 2 characters in body
Source Link
Nick Cox
Nick Cox
  • 59.5k
  • 8
  • 136
  • 212

Entropy is the measure of randomness of a random variable. $$H(X) = -\sum_{x\epsilon X}p(x)log_{2}(p(x))$$$$H(X) = -\sum_{x\in X}p(x)\log_{2}(p(x))$$

The units when using the $log_{2}$$\log_{2}$ is bits i.e., how many bits required to store the information present in the random variable X$X$.

What will be the units of entropy when use other base for log i.e., natural log/log base 10 or any other? How we will interpret those units?

Entropy is the measure of randomness of a random variable. $$H(X) = -\sum_{x\epsilon X}p(x)log_{2}(p(x))$$

The units when using the $log_{2}$ is bits i.e., how many bits required to store the information present in the random variable X.

What will be the units of entropy when use other base for log i.e., natural log/log base 10 or any other? How we will interpret those units?

Entropy is the measure of randomness of a random variable. $$H(X) = -\sum_{x\in X}p(x)\log_{2}(p(x))$$

The units when using the $\log_{2}$ is bits i.e., how many bits required to store the information present in the random variable $X$.

What will be the units of entropy when use other base for log i.e., natural log/log base 10 or any other? How we will interpret those units?

edited question
Source Link
gung - Reinstate Monica
gung - Reinstate Monica
  • 147.5k
  • 89
  • 406
  • 717

Entropy is the measure of randomness of a random variable. $$H(X) = -\sum_{x\epsilon X}p(x)log_{2}(p(x))$$

The units when using the $log_{2}$ is bits i.e., how many bitbits required to store the information present in the random variable X.

What will be the units of entropy when use other base for log i.e., natural log/log base 10 or any other? How we will interpret those units?

Entropy is the measure of randomness of a random variable. $$H(X) = -\sum_{x\epsilon X}p(x)log_{2}(p(x))$$

The units when using the $log_{2}$ is bits i.e how many bit required to store the information present in the random variable X.

What will be the units of entropy when use other base for log i.e natural log/log base 10 or any other? How we will interpret those units?

Entropy is the measure of randomness of a random variable. $$H(X) = -\sum_{x\epsilon X}p(x)log_{2}(p(x))$$

The units when using the $log_{2}$ is bits i.e., how many bits required to store the information present in the random variable X.

What will be the units of entropy when use other base for log i.e., natural log/log base 10 or any other? How we will interpret those units?

edited question
Source Link
edit approved Dec 25, 2016 at 13:15
ilanman
edit approved Dec 25, 2016 at 13:15
ilanman
  • 4.8k
  • 1
  • 29
  • 49

Entropy is the measure of randomness of a random variable. $H(X) = -\sum_{x\epsilon X}p(x) * log_{2}(p(x))$$$H(X) = -\sum_{x\epsilon X}p(x)log_{2}(p(x))$$

The units when using the $log_{2}$ is bits i.e how many bit required to store the information present in the random variable X.

What will be the units of entropy when use other base for log i.e natural log/ loglog base 10 or any other? How we will interpret those units?

*Correct me if i am wrong.

Entropy is the measure of randomness of a random variable. $H(X) = -\sum_{x\epsilon X}p(x) * log_{2}(p(x))$

The units when using the $log_{2}$ is bits i.e how many bit required to store the information present in the random variable X.

What will be the units of entropy when use other base for log i.e natural log/ log base 10 or any other? How we will interpret those units?

*Correct me if i am wrong.

Entropy is the measure of randomness of a random variable. $$H(X) = -\sum_{x\epsilon X}p(x)log_{2}(p(x))$$

The units when using the $log_{2}$ is bits i.e how many bit required to store the information present in the random variable X.

What will be the units of entropy when use other base for log i.e natural log/log base 10 or any other? How we will interpret those units?

Source Link
Sanjeev
Sanjeev
  • 207
  • 2
  • 9