Matches in SemOpenAlex for { <https://semopenalex.org/work/W3105901004> ?p ?o ?g. }
- W3105901004 endingPage "1325" @default.
- W3105901004 startingPage "1325" @default.
- W3105901004 abstract "Information bottleneck (IB) and privacy funnel (PF) are two closely related optimization problems which have found applications in machine learning, design of privacy algorithms, capacity problems (e.g., Mrs. Gerber's Lemma), strong data processing inequalities, among others. In this work, we first investigate the functional properties of IB and PF through a unified theoretical framework. We then connect them to three information-theoretic coding problems, namely hypothesis testing against independence, noisy source coding and dependence dilution. Leveraging these connections, we prove a new cardinality bound for the auxiliary variable in IB, making its computation more tractable for discrete random variables. In the second part, we introduce a general family of optimization problems, termed as textit{bottleneck problems}, by replacing mutual information in IB and PF with other notions of mutual information, namely $f$-information and Arimoto's mutual information. We then argue that, unlike IB and PF, these problems lead to easily interpretable guarantee in a variety of inference tasks with statistical constraints on accuracy and privacy. Although the underlying optimization problems are non-convex, we develop a technique to evaluate bottleneck problems in closed form by equivalently expressing them in terms of lower convex or upper concave envelope of certain functions. By applying this technique to binary case, we derive closed form expressions for several bottleneck problems." @default.
- W3105901004 created "2020-11-23" @default.
- W3105901004 creator A5062359324 @default.
- W3105901004 creator A5074697940 @default.
- W3105901004 date "2020-11-20" @default.
- W3105901004 modified "2023-10-09" @default.
- W3105901004 title "Bottleneck Problems: An Information and Estimation-Theoretic View" @default.
- W3105901004 cites W1990742913 @default.
- W3105901004 cites W2003776291 @default.
- W3105901004 cites W2018582985 @default.
- W3105901004 cites W2021238795 @default.
- W3105901004 cites W2021547642 @default.
- W3105901004 cites W2028549854 @default.
- W3105901004 cites W2062843442 @default.
- W3105901004 cites W2084360170 @default.
- W3105901004 cites W2104641770 @default.
- W3105901004 cites W2111616148 @default.
- W3105901004 cites W2114085948 @default.
- W3105901004 cites W2123469175 @default.
- W3105901004 cites W2129774678 @default.
- W3105901004 cites W2131940723 @default.
- W3105901004 cites W2143121893 @default.
- W3105901004 cites W2151320232 @default.
- W3105901004 cites W2151533263 @default.
- W3105901004 cites W2157638198 @default.
- W3105901004 cites W2157962569 @default.
- W3105901004 cites W2158051692 @default.
- W3105901004 cites W2168614937 @default.
- W3105901004 cites W2173267959 @default.
- W3105901004 cites W2296510033 @default.
- W3105901004 cites W2407163532 @default.
- W3105901004 cites W2518143623 @default.
- W3105901004 cites W2611269208 @default.
- W3105901004 cites W2770297754 @default.
- W3105901004 cites W2780383826 @default.
- W3105901004 cites W2795414739 @default.
- W3105901004 cites W2797548502 @default.
- W3105901004 cites W2880214242 @default.
- W3105901004 cites W2899742260 @default.
- W3105901004 cites W2962957257 @default.
- W3105901004 cites W2963343988 @default.
- W3105901004 cites W2963423396 @default.
- W3105901004 cites W2963634943 @default.
- W3105901004 cites W2963971563 @default.
- W3105901004 cites W2964074411 @default.
- W3105901004 cites W2964157181 @default.
- W3105901004 cites W2967916697 @default.
- W3105901004 cites W2968437089 @default.
- W3105901004 cites W2971533378 @default.
- W3105901004 cites W2998261580 @default.
- W3105901004 cites W3022414928 @default.
- W3105901004 cites W3080462207 @default.
- W3105901004 cites W3101467561 @default.
- W3105901004 cites W3103727670 @default.
- W3105901004 cites W3106311775 @default.
- W3105901004 cites W3140053156 @default.
- W3105901004 doi "https://doi.org/10.3390/e22111325" @default.
- W3105901004 hasPubMedCentralId "https://www.ncbi.nlm.nih.gov/pmc/articles/7712227" @default.
- W3105901004 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/33287090" @default.
- W3105901004 hasPublicationYear "2020" @default.
- W3105901004 type Work @default.
- W3105901004 sameAs 3105901004 @default.
- W3105901004 citedByCount "8" @default.
- W3105901004 countsByYear W31059010042021 @default.
- W3105901004 countsByYear W31059010042023 @default.
- W3105901004 crossrefType "journal-article" @default.
- W3105901004 hasAuthorship W3105901004A5062359324 @default.
- W3105901004 hasAuthorship W3105901004A5074697940 @default.
- W3105901004 hasBestOaLocation W31059010041 @default.
- W3105901004 hasConcept C105795698 @default.
- W3105901004 hasConcept C112680207 @default.
- W3105901004 hasConcept C11413529 @default.
- W3105901004 hasConcept C118615104 @default.
- W3105901004 hasConcept C122123141 @default.
- W3105901004 hasConcept C126255220 @default.
- W3105901004 hasConcept C134306372 @default.
- W3105901004 hasConcept C137836250 @default.
- W3105901004 hasConcept C149635348 @default.
- W3105901004 hasConcept C152139883 @default.
- W3105901004 hasConcept C154945302 @default.
- W3105901004 hasConcept C157972887 @default.
- W3105901004 hasConcept C19220575 @default.
- W3105901004 hasConcept C2524010 @default.
- W3105901004 hasConcept C2780513914 @default.
- W3105901004 hasConcept C33923547 @default.
- W3105901004 hasConcept C41008148 @default.
- W3105901004 hasConcept C52622258 @default.
- W3105901004 hasConcept C60008888 @default.
- W3105901004 hasConcept C77553402 @default.
- W3105901004 hasConcept C80444323 @default.
- W3105901004 hasConceptScore W3105901004C105795698 @default.
- W3105901004 hasConceptScore W3105901004C112680207 @default.
- W3105901004 hasConceptScore W3105901004C11413529 @default.
- W3105901004 hasConceptScore W3105901004C118615104 @default.
- W3105901004 hasConceptScore W3105901004C122123141 @default.
- W3105901004 hasConceptScore W3105901004C126255220 @default.
- W3105901004 hasConceptScore W3105901004C134306372 @default.
- W3105901004 hasConceptScore W3105901004C137836250 @default.