Matches in SemOpenAlex for { <https://semopenalex.org/work/W2240563783> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W2240563783 abstract "Lossy compression and clustering fundamentally involve a decision about what features are relevant and which are not. The information bottleneck method (IB) by Tishby, Pereira, and Bialek formalized this notion as an information-theoretic optimization problem and proposed an optimal tradeoff between throwing away as many bits as possible, and selectively keeping those that are most important. In the IB, compression is measure my mutual information. Here, we introduce an alternative formulation that replaces mutual information with entropy, which we call the deterministic information bottleneck (DIB), that we argue better captures this notion of compression. As suggested by its name, the solution to the DIB problem turns out to be a deterministic encoder, or hard clustering, as opposed to the stochastic encoder, or soft clustering, that is optimal under the IB. We compare the IB and DIB on synthetic data, showing that the IB and DIB perform similarly in terms of the IB cost function, but that the DIB significantly outperforms the IB in terms of the DIB cost function. We also empirically find that the DIB offers a considerable gain in computational efficiency over the IB, over a range of convergence parameters. Our derivation of the DIB also suggests a method for continuously interpolating between the soft clustering of the IB and the hard clustering of the DIB." @default.
- W2240563783 created "2016-06-24" @default.
- W2240563783 creator A5060296717 @default.
- W2240563783 creator A5089226694 @default.
- W2240563783 date "2016-04-01" @default.
- W2240563783 modified "2023-09-27" @default.
- W2240563783 title "The deterministic information bottleneck" @default.
- W2240563783 cites W2040903332 @default.
- W2240563783 cites W2042925217 @default.
- W2240563783 cites W2125290066 @default.
- W2240563783 cites W2141863509 @default.
- W2240563783 hasPublicationYear "2016" @default.
- W2240563783 type Work @default.
- W2240563783 sameAs 2240563783 @default.
- W2240563783 citedByCount "6" @default.
- W2240563783 countsByYear W22405637832016 @default.
- W2240563783 countsByYear W22405637832017 @default.
- W2240563783 countsByYear W22405637832018 @default.
- W2240563783 countsByYear W22405637832021 @default.
- W2240563783 crossrefType "posted-content" @default.
- W2240563783 hasAuthorship W2240563783A5060296717 @default.
- W2240563783 hasAuthorship W2240563783A5089226694 @default.
- W2240563783 hasConcept C105795698 @default.
- W2240563783 hasConcept C106301342 @default.
- W2240563783 hasConcept C11413529 @default.
- W2240563783 hasConcept C121332964 @default.
- W2240563783 hasConcept C126255220 @default.
- W2240563783 hasConcept C149635348 @default.
- W2240563783 hasConcept C152139883 @default.
- W2240563783 hasConcept C154945302 @default.
- W2240563783 hasConcept C2780513914 @default.
- W2240563783 hasConcept C33923547 @default.
- W2240563783 hasConcept C41008148 @default.
- W2240563783 hasConcept C52622258 @default.
- W2240563783 hasConcept C60008888 @default.
- W2240563783 hasConcept C62520636 @default.
- W2240563783 hasConcept C73555534 @default.
- W2240563783 hasConcept C80444323 @default.
- W2240563783 hasConceptScore W2240563783C105795698 @default.
- W2240563783 hasConceptScore W2240563783C106301342 @default.
- W2240563783 hasConceptScore W2240563783C11413529 @default.
- W2240563783 hasConceptScore W2240563783C121332964 @default.
- W2240563783 hasConceptScore W2240563783C126255220 @default.
- W2240563783 hasConceptScore W2240563783C149635348 @default.
- W2240563783 hasConceptScore W2240563783C152139883 @default.
- W2240563783 hasConceptScore W2240563783C154945302 @default.
- W2240563783 hasConceptScore W2240563783C2780513914 @default.
- W2240563783 hasConceptScore W2240563783C33923547 @default.
- W2240563783 hasConceptScore W2240563783C41008148 @default.
- W2240563783 hasConceptScore W2240563783C52622258 @default.
- W2240563783 hasConceptScore W2240563783C60008888 @default.
- W2240563783 hasConceptScore W2240563783C62520636 @default.
- W2240563783 hasConceptScore W2240563783C73555534 @default.
- W2240563783 hasConceptScore W2240563783C80444323 @default.
- W2240563783 hasLocation W22405637831 @default.
- W2240563783 hasOpenAccess W2240563783 @default.
- W2240563783 hasPrimaryLocation W22405637831 @default.
- W2240563783 hasRelatedWork W1580236712 @default.
- W2240563783 hasRelatedWork W1686946872 @default.
- W2240563783 hasRelatedWork W2099111195 @default.
- W2240563783 hasRelatedWork W2150348874 @default.
- W2240563783 hasRelatedWork W2401084945 @default.
- W2240563783 hasRelatedWork W2592445944 @default.
- W2240563783 hasRelatedWork W2797548502 @default.
- W2240563783 hasRelatedWork W2886129097 @default.
- W2240563783 hasRelatedWork W2950696215 @default.
- W2240563783 hasRelatedWork W2963103083 @default.
- W2240563783 hasRelatedWork W2964041897 @default.
- W2240563783 hasRelatedWork W2965302384 @default.
- W2240563783 hasRelatedWork W3046005725 @default.
- W2240563783 hasRelatedWork W3046763715 @default.
- W2240563783 hasRelatedWork W3133352888 @default.
- W2240563783 hasRelatedWork W3171327347 @default.
- W2240563783 hasRelatedWork W3200432867 @default.
- W2240563783 hasRelatedWork W3203399909 @default.
- W2240563783 hasRelatedWork W3207741394 @default.
- W2240563783 hasRelatedWork W73426805 @default.
- W2240563783 isParatext "false" @default.
- W2240563783 isRetracted "false" @default.
- W2240563783 magId "2240563783" @default.
- W2240563783 workType "article" @default.