Consider two random variables $X_1, X_2$ and their entropy $H(X_1), H(X_2)$. Let $V$ be a random variable which takes values $1,2$ with equal probability.

Problem Statement

Let $\frac{dH(X_1)}{d\theta} = -1 $ and $\frac{dH(X_2)}{d\theta} = -1$, can we say that $\frac{dH(X_V)}{d\theta} <= 0 $ ?

  • $\begingroup$ Do you mean $V$ takes values from $X_1$ and $X_2$ with equal prob? and what is $\theta$ ? $\endgroup$ – horaceT Sep 15 '16 at 22:56
  • $\begingroup$ $X_V$ takes values from $X_1$ and $X_2$ with equal probability. P(X_v=x) = 0.5*P(X_1 = x )+ 0.5*P(X_2=x). $\theta$ is a parameter on which $X_1$ and $X_2$ depend. $\endgroup$ – Vivek Bagaria Sep 15 '16 at 23:22
  • $\begingroup$ I could give more details about $\theta$ but..it will make the problem messy. $\endgroup$ – Vivek Bagaria Sep 15 '16 at 23:24

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.