Matches in SemOpenAlex for { <https://semopenalex.org/work/W3023175709> ?p ?o ?g. }
- W3023175709 endingPage "144" @default.
- W3023175709 startingPage "131" @default.
- W3023175709 abstract "We propose a novel strategy for extracting features in supervised learning that can be used to construct a classifier which is more robust to small perturbations in the input space. Our method builds upon the idea of the information bottleneck, by introducing an additional penalty term that encourages the Fisher information of the extracted features to be small when parametrized by the inputs. We present two formulations where the relevance of the features to output labels is measured using either mutual information or MMSE. By tuning the regularization parameter, we can explicitly trade off the opposing desiderata of robustness and accuracy when constructing a classifier. We derive optimal solutions to both robust information bottleneck formulations when the inputs and outputs are jointly Gaussian, proving that the optimally robust features are also jointly Gaussian in this setting. We also propose methods for optimizing variational bounds on the robust information bottleneck objectives in general settings using stochastic gradient descent, which may be implemented efficiently in neural networks. Our experimental results for synthetic and real data sets show that the proposed feature extraction methods indeed produce classifiers with increased robustness to perturbations." @default.
- W3023175709 created "2020-05-13" @default.
- W3023175709 creator A5021502006 @default.
- W3023175709 creator A5023368186 @default.
- W3023175709 creator A5046067745 @default.
- W3023175709 date "2020-05-01" @default.
- W3023175709 modified "2023-10-02" @default.
- W3023175709 title "Extracting Robust and Accurate Features via a Robust Information Bottleneck" @default.
- W3023175709 cites W1965042169 @default.
- W3023175709 cites W1974454156 @default.
- W3023175709 cites W2002867407 @default.
- W3023175709 cites W2041880317 @default.
- W3023175709 cites W2043371182 @default.
- W3023175709 cites W2051868869 @default.
- W3023175709 cites W2060314721 @default.
- W3023175709 cites W2099294566 @default.
- W3023175709 cites W2123469175 @default.
- W3023175709 cites W2141761557 @default.
- W3023175709 cites W2144094762 @default.
- W3023175709 cites W2154221712 @default.
- W3023175709 cites W2156163116 @default.
- W3023175709 cites W2171750587 @default.
- W3023175709 cites W2171801319 @default.
- W3023175709 cites W2257979135 @default.
- W3023175709 cites W2473418344 @default.
- W3023175709 cites W2543927648 @default.
- W3023175709 cites W2773633221 @default.
- W3023175709 cites W2792772107 @default.
- W3023175709 cites W2964184826 @default.
- W3023175709 cites W2964192498 @default.
- W3023175709 cites W2975007897 @default.
- W3023175709 cites W4241772732 @default.
- W3023175709 doi "https://doi.org/10.1109/jsait.2020.2991005" @default.
- W3023175709 hasPublicationYear "2020" @default.
- W3023175709 type Work @default.
- W3023175709 sameAs 3023175709 @default.
- W3023175709 citedByCount "14" @default.
- W3023175709 countsByYear W30231757092020 @default.
- W3023175709 countsByYear W30231757092021 @default.
- W3023175709 countsByYear W30231757092022 @default.
- W3023175709 countsByYear W30231757092023 @default.
- W3023175709 crossrefType "journal-article" @default.
- W3023175709 hasAuthorship W3023175709A5021502006 @default.
- W3023175709 hasAuthorship W3023175709A5023368186 @default.
- W3023175709 hasAuthorship W3023175709A5046067745 @default.
- W3023175709 hasBestOaLocation W30231757091 @default.
- W3023175709 hasConcept C104317684 @default.
- W3023175709 hasConcept C11413529 @default.
- W3023175709 hasConcept C119857082 @default.
- W3023175709 hasConcept C121332964 @default.
- W3023175709 hasConcept C124101348 @default.
- W3023175709 hasConcept C149635348 @default.
- W3023175709 hasConcept C152139883 @default.
- W3023175709 hasConcept C153180895 @default.
- W3023175709 hasConcept C153258448 @default.
- W3023175709 hasConcept C154945302 @default.
- W3023175709 hasConcept C163716315 @default.
- W3023175709 hasConcept C185592680 @default.
- W3023175709 hasConcept C2780513914 @default.
- W3023175709 hasConcept C29406490 @default.
- W3023175709 hasConcept C41008148 @default.
- W3023175709 hasConcept C50644808 @default.
- W3023175709 hasConcept C55493867 @default.
- W3023175709 hasConcept C60008888 @default.
- W3023175709 hasConcept C62520636 @default.
- W3023175709 hasConcept C63479239 @default.
- W3023175709 hasConcept C95623464 @default.
- W3023175709 hasConceptScore W3023175709C104317684 @default.
- W3023175709 hasConceptScore W3023175709C11413529 @default.
- W3023175709 hasConceptScore W3023175709C119857082 @default.
- W3023175709 hasConceptScore W3023175709C121332964 @default.
- W3023175709 hasConceptScore W3023175709C124101348 @default.
- W3023175709 hasConceptScore W3023175709C149635348 @default.
- W3023175709 hasConceptScore W3023175709C152139883 @default.
- W3023175709 hasConceptScore W3023175709C153180895 @default.
- W3023175709 hasConceptScore W3023175709C153258448 @default.
- W3023175709 hasConceptScore W3023175709C154945302 @default.
- W3023175709 hasConceptScore W3023175709C163716315 @default.
- W3023175709 hasConceptScore W3023175709C185592680 @default.
- W3023175709 hasConceptScore W3023175709C2780513914 @default.
- W3023175709 hasConceptScore W3023175709C29406490 @default.
- W3023175709 hasConceptScore W3023175709C41008148 @default.
- W3023175709 hasConceptScore W3023175709C50644808 @default.
- W3023175709 hasConceptScore W3023175709C55493867 @default.
- W3023175709 hasConceptScore W3023175709C60008888 @default.
- W3023175709 hasConceptScore W3023175709C62520636 @default.
- W3023175709 hasConceptScore W3023175709C63479239 @default.
- W3023175709 hasConceptScore W3023175709C95623464 @default.
- W3023175709 hasFunder F4320309480 @default.
- W3023175709 hasFunder F4320335353 @default.
- W3023175709 hasIssue "1" @default.
- W3023175709 hasLocation W30231757091 @default.
- W3023175709 hasLocation W30231757092 @default.
- W3023175709 hasOpenAccess W3023175709 @default.
- W3023175709 hasPrimaryLocation W30231757091 @default.
- W3023175709 hasRelatedWork W2103723258 @default.
- W3023175709 hasRelatedWork W2783047733 @default.
- W3023175709 hasRelatedWork W2982402336 @default.