bibkey: “tishby2000information” authors: “Naftali Tishby; Fernando C. Pereira; William Bialek” year: 2000 title: “The information bottleneck method” doi: null claim: “The information bottleneck objective trades representation information against retained predictive information under a specified joint law.” strata_touched: [] license: “citation-only” triage: “anchor” url: “https://arxiv.org/abs/physics/0004057”
The information bottleneck method
Verified locator
arXiv:physics/0004057v1, Section 3.1, page 9, equation (15). The manuscript is dated 30 September 1999; the year field and bibkey refer to the verified arXiv submission on 24 April 2000. The finite-alphabet objective is I(X;Z) minus beta times I(Z;Y), with a stochastic encoder and a specified joint distribution. This optimization does not imply exact predictive sufficiency, uniform intervention guarantees, or a unique general definition of intelligence.