Entropy / CONCEPT
Mutual Information as an Entropy Balance
Finite mutual information in nats decomposes into marginal and joint Shannon entropies, yielding entropy subadditivity.
Closed
DIRECT PREREQUISITES2
DIRECT CONSEQUENCES5
PROOF DEPTH3
DOCUMENT LINKS1
Mutual information is the entropy balance
RELATIONSHIP ATLAS
Every connection, in context.
Direct recorded relationships
Proof dependencyStructural affinityDocument link
Certified topology / UPSTREAM
Prerequisites
Certified topology / DOWNSTREAM
Consequences
- Conditioning Reduces Entropytruth-dependency · Closed
- Estimator-Error Lower Bounds from Finite Fano Inequalitiestruth-dependency · Closed
- Expected Posterior Entropy Reductiontruth-dependency · Closed
- Macroscopic Predictive Efficiency Increasetruth-dependency · Closed
- Strong Subadditivity and Conditional Productstruth-dependency · Closed
RELATED KNOWLEDGE
Structural connections
- Collision Entropy versus Shannon Entropystructural-affinity · Closed
- Collision-Entropy Uncertaintystructural-affinity · Closed
- Conditional Mutual Informationstructural-affinity · Closed
- Conditioning Reduces Entropystructural-affinity · Closed
- Estimator-Error Lower Bounds from Finite Fano Inequalitiesstructural-affinity · Closed
- Expected Posterior Entropy Reductionstructural-affinity · Closed
- Macroscopic Predictive Efficiency Increasestructural-affinity · Closed
- Maximum Entropy on a Finite Alphabetstructural-affinity · Closed
- Mutual Information Vanishes on Product Lawsstructural-affinity · Closed
- Nonnegativity of Finite Classical Mutual Informationstructural-affinity · Closed
- Sharp Finite Fano Inequality in Natsstructural-affinity · Closed
- Strong Subadditivity and Conditional Productsstructural-affinity · Closed
- Symmetry of Finite Mutual Informationstructural-affinity · Closed
- The Feedback Divergence Identitystructural-affinity · Closed
- Vanishing Mutual Information Characterizes Independencestructural-affinity · Closed
Documents & exposition
Other authored & advisory relationships
None recorded in this release.
LIBRARY / RELEASE VERSIONS
Content history
Loading release versions...
Browse the archiveCertified provenance