Exercise 15.4: More Properties of Shannon Entropy
Recall the definition
(a)
Use non-negativity of the mutual information:
(b)
Follows from a direct computation:
(c)
Follows from (a) applied to the r.h.s. of (b).
Recall the definition
Use non-negativity of the mutual information:
Follows from a direct computation:
Follows from (a) applied to the r.h.s. of (b).