Matches in SemOpenAlex for { <https://semopenalex.org/work/W3105392875> ?p ?o ?g. }
Showing items 1 to 84 of
84
with 100 items per page.
- W3105392875 abstract "Mutual information (MI) is an information-theoretic measure of dependency between two random variables. Several methods to estimate MI, from samples of two random variables with unknown underlying probability distributions have been proposed in the literature. Recent methods realize parametric probability distributions or critic as a neural network to approximate unknown density ratios. The approximated density ratios are used to estimate different variational lower bounds of MI. While these methods provide reliable estimation when the true MI is low, they produce high variance estimates in cases of high MI. We argue that the high variance characteristic is due to the uncontrolled complexity of the critic's hypothesis space. In support of this argument, we use the data-driven Rademacher complexity of the hypothesis space associated with the critic's architecture to analyse generalization error bound of variational lower bound estimates of MI. In the proposed work, we show that it is possible to negate the high variance characteristics of these estimators by constraining the critic's hypothesis space to Reproducing Hilbert Kernel Space (RKHS), which corresponds to a kernel learned using Automated Spectral Kernel Learning (ASKL). By analysing the aforementioned generalization error bounds, we augment the overall optimisation objective with effective regularisation term. We empirically demonstrate the efficacy of this regularization in enforcing proper bias variance tradeoff on four variational lower bounds, namely NWJ, MINE, JS and SMILE." @default.
- W3105392875 created "2020-11-23" @default.
- W3105392875 creator A5000176044 @default.
- W3105392875 creator A5052201567 @default.
- W3105392875 creator A5080334347 @default.
- W3105392875 date "2020-11-17" @default.
- W3105392875 modified "2023-10-14" @default.
- W3105392875 title "Reducing the Variance of Variational Estimates of Mutual Information by Limiting the Critic's Hypothesis Space to RKHS" @default.
- W3105392875 cites W2135498906 @default.
- W3105392875 cites W2579923771 @default.
- W3105392875 cites W2997905006 @default.
- W3105392875 hasPublicationYear "2020" @default.
- W3105392875 type Work @default.
- W3105392875 sameAs 3105392875 @default.
- W3105392875 citedByCount "0" @default.
- W3105392875 crossrefType "posted-content" @default.
- W3105392875 hasAuthorship W3105392875A5000176044 @default.
- W3105392875 hasAuthorship W3105392875A5052201567 @default.
- W3105392875 hasAuthorship W3105392875A5080334347 @default.
- W3105392875 hasConcept C102366305 @default.
- W3105392875 hasConcept C105795698 @default.
- W3105392875 hasConcept C11413529 @default.
- W3105392875 hasConcept C118615104 @default.
- W3105392875 hasConcept C126255220 @default.
- W3105392875 hasConcept C134306372 @default.
- W3105392875 hasConcept C152139883 @default.
- W3105392875 hasConcept C154945302 @default.
- W3105392875 hasConcept C177148314 @default.
- W3105392875 hasConcept C185429906 @default.
- W3105392875 hasConcept C2776135515 @default.
- W3105392875 hasConcept C28826006 @default.
- W3105392875 hasConcept C33923547 @default.
- W3105392875 hasConcept C41008148 @default.
- W3105392875 hasConcept C62799726 @default.
- W3105392875 hasConcept C71134354 @default.
- W3105392875 hasConcept C74193536 @default.
- W3105392875 hasConcept C77553402 @default.
- W3105392875 hasConcept C80884492 @default.
- W3105392875 hasConceptScore W3105392875C102366305 @default.
- W3105392875 hasConceptScore W3105392875C105795698 @default.
- W3105392875 hasConceptScore W3105392875C11413529 @default.
- W3105392875 hasConceptScore W3105392875C118615104 @default.
- W3105392875 hasConceptScore W3105392875C126255220 @default.
- W3105392875 hasConceptScore W3105392875C134306372 @default.
- W3105392875 hasConceptScore W3105392875C152139883 @default.
- W3105392875 hasConceptScore W3105392875C154945302 @default.
- W3105392875 hasConceptScore W3105392875C177148314 @default.
- W3105392875 hasConceptScore W3105392875C185429906 @default.
- W3105392875 hasConceptScore W3105392875C2776135515 @default.
- W3105392875 hasConceptScore W3105392875C28826006 @default.
- W3105392875 hasConceptScore W3105392875C33923547 @default.
- W3105392875 hasConceptScore W3105392875C41008148 @default.
- W3105392875 hasConceptScore W3105392875C62799726 @default.
- W3105392875 hasConceptScore W3105392875C71134354 @default.
- W3105392875 hasConceptScore W3105392875C74193536 @default.
- W3105392875 hasConceptScore W3105392875C77553402 @default.
- W3105392875 hasConceptScore W3105392875C80884492 @default.
- W3105392875 hasLocation W31053928751 @default.
- W3105392875 hasOpenAccess W3105392875 @default.
- W3105392875 hasPrimaryLocation W31053928751 @default.
- W3105392875 hasRelatedWork W1793048902 @default.
- W3105392875 hasRelatedWork W1967417164 @default.
- W3105392875 hasRelatedWork W2097774331 @default.
- W3105392875 hasRelatedWork W2099442408 @default.
- W3105392875 hasRelatedWork W2109357635 @default.
- W3105392875 hasRelatedWork W2158040987 @default.
- W3105392875 hasRelatedWork W2519513981 @default.
- W3105392875 hasRelatedWork W2531031089 @default.
- W3105392875 hasRelatedWork W2895906462 @default.
- W3105392875 hasRelatedWork W2938943746 @default.
- W3105392875 hasRelatedWork W2963319343 @default.
- W3105392875 hasRelatedWork W3003876312 @default.
- W3105392875 hasRelatedWork W3010034546 @default.
- W3105392875 hasRelatedWork W3018071614 @default.
- W3105392875 hasRelatedWork W3035079661 @default.
- W3105392875 hasRelatedWork W3104140564 @default.
- W3105392875 hasRelatedWork W3136633797 @default.
- W3105392875 hasRelatedWork W3158932533 @default.
- W3105392875 hasRelatedWork W3196740913 @default.
- W3105392875 hasRelatedWork W3209689972 @default.
- W3105392875 isParatext "false" @default.
- W3105392875 isRetracted "false" @default.
- W3105392875 magId "3105392875" @default.
- W3105392875 workType "article" @default.