Entropy / CONCEPT
Mutual-Information Chain Rule
For a finite joint law, the information in a pair of observations splits into the information in the first observation and the remaining conditional information.
Closed
DIRECT PREREQUISITES2
DIRECT CONSEQUENCES4
PROOF DEPTH7
DOCUMENT LINKS1
Mutual information obeys the chain rule
RELATIONSHIP ATLAS
Every connection, in context.
Direct recorded relationships
Proof dependencyStructural affinityDocument link
Certified topology / UPSTREAM
Prerequisites
Certified topology / DOWNSTREAM
Consequences
RELATED KNOWLEDGE
Structural connections
- Canonical Conditional Information Submodularitystructural-affinity · Closed
- Canonical Predictive-State Sufficiencystructural-affinity · Closed
- Coarse-Graining Cannot Add Informationstructural-affinity · Closed
- Conditional Choice-Outcome Chain Rulestructural-affinity · Closed
- Conditional Information Postprocessingstructural-affinity · Closed
- Conditional Mutual Informationstructural-affinity · Closed
- Conditional-Independent Information Submodularitystructural-affinity · Closed
- Fano Error Bounds after Finite Channelsstructural-affinity · Closed
- Large-Innovation Count Boundstructural-affinity · Closed
- Macroscopic Predictive Efficiency Increasestructural-affinity · Closed
- Markov Data Processingstructural-affinity · Closed
- Positive-Prior Conditional Independencestructural-affinity · Closed
- Prediction Closure Criterionstructural-affinity · Closed
- Predictive Memory Monotonicitystructural-affinity · Closed
- Predictive Memory under Deterministic Refinementstructural-affinity · Closed
- Symmetry of Finite Mutual Informationstructural-affinity · Closed
- The Finite Mixture Entropy Bracketstructural-affinity · Closed
Documents & exposition
Other authored & advisory relationships
None recorded in this release.
LIBRARY / RELEASE VERSIONS
Content history
Loading release versions...
Browse the archiveCertified provenance