Entropy

Navigation page for Blueprint/D5/S3/Entropy/ at upstream snapshot 55a96922002fdbf5644c47264702e325d0b475c9.

Contents

• Conditional Entropy and Its Chain Rule
• Equality at the Lower Endpoint of Conditional Entropy
• Conditioning Reduces Entropy
• The Entropy-Divergence Consistency Identity
• Equality Cases for Finite Shannon Entropy
• Nonnegativity of Finite Entropy
• Feedback
• Forgetting
• Fusion
• Maximum Entropy on a Finite Alphabet
• Mixing
• Nonnegativity of Finite Classical Mutual Information
• Mutual Information as an Entropy Balance
• Vanishing Mutual Information Characterizes Independence
• Mutual Information Vanishes on Product Laws
• Symmetry of Finite Mutual Information
• NamingWindow
• Observation
• Relabeling
• Submodularity
• Thermodynamics