Matches in SemOpenAlex for { <https://semopenalex.org/work/W3204806350> ?p ?o ?g. }
- W3204806350 abstract "Deep neural networks (DNNs) often rely on easy-to-learn discriminatory features, or cues, that are not necessarily essential to the problem at hand. For example, ducks in an image may be recognized based on their typical background scenery, such as lakes or streams. This phenomenon, also known as shortcut learning, is emerging as a key limitation of the current generation of machine learning models. In this work, we introduce a set of experiments to deepen our understanding of shortcut learning and its implications. We design a training setup with several shortcut cues, named WCST-ML, where each cue is equally conducive to the visual recognition problem at hand. Even under equal opportunities, we observe that (1) certain cues are preferred to others, (2) solutions biased to the easy-to-learn cues tend to converge to relatively flat minima on the loss surface, and (3) the solutions focusing on those preferred cues are far more abundant in the parameter space. We explain the abundance of certain cues via their Kolmogorov (descriptional) complexity: solutions corresponding to Kolmogorov-simple cues are abundant in the parameter space and are thus preferred by DNNs. Our studies are based on the synthetic dataset DSprites and the face dataset UTKFace. In our WCST-ML, we observe that the inborn bias of models leans toward simple cues, such as color and ethnicity. Our findings emphasize the importance of active human intervention to remove the inborn model biases that may cause negative societal impacts." @default.
- W3204806350 created "2021-10-11" @default.
- W3204806350 creator A5003220288 @default.
- W3204806350 creator A5025851635 @default.
- W3204806350 creator A5067167236 @default.
- W3204806350 creator A5078213488 @default.
- W3204806350 creator A5090728849 @default.
- W3204806350 date "2021-10-06" @default.
- W3204806350 modified "2023-09-23" @default.
- W3204806350 title "Which Shortcut Cues Will DNNs Choose? A Study from the Parameter-Space Perspective" @default.
- W3204806350 cites W1677182931 @default.
- W3204806350 cites W2018140810 @default.
- W3204806350 cites W2147043257 @default.
- W3204806350 cites W2194775991 @default.
- W3204806350 cites W2257979135 @default.
- W3204806350 cites W2592232824 @default.
- W3204806350 cites W2731468224 @default.
- W3204806350 cites W2770241596 @default.
- W3204806350 cites W2792287754 @default.
- W3204806350 cites W2794316594 @default.
- W3204806350 cites W2902617128 @default.
- W3204806350 cites W2946954062 @default.
- W3204806350 cites W2962933129 @default.
- W3204806350 cites W2963025848 @default.
- W3204806350 cites W2963384892 @default.
- W3204806350 cites W2963818033 @default.
- W3204806350 cites W2964122761 @default.
- W3204806350 cites W2964137095 @default.
- W3204806350 cites W2970017794 @default.
- W3204806350 cites W2970454961 @default.
- W3204806350 cites W2990751682 @default.
- W3204806350 cites W3014590323 @default.
- W3204806350 cites W3016970897 @default.
- W3204806350 cites W3035037113 @default.
- W3204806350 cites W3035712793 @default.
- W3204806350 cites W3099180329 @default.
- W3204806350 cites W3100924069 @default.
- W3204806350 cites W3119786062 @default.
- W3204806350 cites W3127463063 @default.
- W3204806350 cites W3132995741 @default.
- W3204806350 cites W3133964188 @default.
- W3204806350 cites W3170874841 @default.
- W3204806350 cites W3181414820 @default.
- W3204806350 cites W3210045201 @default.
- W3204806350 doi "https://doi.org/10.48550/arxiv.2110.03095" @default.
- W3204806350 hasPublicationYear "2021" @default.
- W3204806350 type Work @default.
- W3204806350 sameAs 3204806350 @default.
- W3204806350 citedByCount "0" @default.
- W3204806350 crossrefType "posted-content" @default.
- W3204806350 hasAuthorship W3204806350A5003220288 @default.
- W3204806350 hasAuthorship W3204806350A5025851635 @default.
- W3204806350 hasAuthorship W3204806350A5067167236 @default.
- W3204806350 hasAuthorship W3204806350A5078213488 @default.
- W3204806350 hasAuthorship W3204806350A5090728849 @default.
- W3204806350 hasBestOaLocation W32048063501 @default.
- W3204806350 hasConcept C111370547 @default.
- W3204806350 hasConcept C111472728 @default.
- W3204806350 hasConcept C111919701 @default.
- W3204806350 hasConcept C119857082 @default.
- W3204806350 hasConcept C12713177 @default.
- W3204806350 hasConcept C134306372 @default.
- W3204806350 hasConcept C138885662 @default.
- W3204806350 hasConcept C144024400 @default.
- W3204806350 hasConcept C154945302 @default.
- W3204806350 hasConcept C15744967 @default.
- W3204806350 hasConcept C177264268 @default.
- W3204806350 hasConcept C180747234 @default.
- W3204806350 hasConcept C186633575 @default.
- W3204806350 hasConcept C199360897 @default.
- W3204806350 hasConcept C2778572836 @default.
- W3204806350 hasConcept C2779304628 @default.
- W3204806350 hasConcept C2780586882 @default.
- W3204806350 hasConcept C33923547 @default.
- W3204806350 hasConcept C36289849 @default.
- W3204806350 hasConcept C41008148 @default.
- W3204806350 hasConceptScore W3204806350C111370547 @default.
- W3204806350 hasConceptScore W3204806350C111472728 @default.
- W3204806350 hasConceptScore W3204806350C111919701 @default.
- W3204806350 hasConceptScore W3204806350C119857082 @default.
- W3204806350 hasConceptScore W3204806350C12713177 @default.
- W3204806350 hasConceptScore W3204806350C134306372 @default.
- W3204806350 hasConceptScore W3204806350C138885662 @default.
- W3204806350 hasConceptScore W3204806350C144024400 @default.
- W3204806350 hasConceptScore W3204806350C154945302 @default.
- W3204806350 hasConceptScore W3204806350C15744967 @default.
- W3204806350 hasConceptScore W3204806350C177264268 @default.
- W3204806350 hasConceptScore W3204806350C180747234 @default.
- W3204806350 hasConceptScore W3204806350C186633575 @default.
- W3204806350 hasConceptScore W3204806350C199360897 @default.
- W3204806350 hasConceptScore W3204806350C2778572836 @default.
- W3204806350 hasConceptScore W3204806350C2779304628 @default.
- W3204806350 hasConceptScore W3204806350C2780586882 @default.
- W3204806350 hasConceptScore W3204806350C33923547 @default.
- W3204806350 hasConceptScore W3204806350C36289849 @default.
- W3204806350 hasConceptScore W3204806350C41008148 @default.
- W3204806350 hasLocation W32048063501 @default.
- W3204806350 hasOpenAccess W3204806350 @default.
- W3204806350 hasPrimaryLocation W32048063501 @default.
- W3204806350 hasRelatedWork W10763751 @default.