Exercise Problems: Information Theory and Coding

Entropies Defined, and Why They Are Measures of Information. Marginal entropy, joint entropy, conditional entropy, and the Chain Rule for entropy.

Thermodynamics