Matches in SemOpenAlex for { <https://semopenalex.org/work/W3189743387> ?p ?o ?g. }
- W3189743387 abstract "Contrastive learning is one of the fastest growing research areas in machine learning due to its ability to learn useful representations without labeled data. However, contrastive learning is susceptible to shortcuts - i.e., it may learn shortcut features irrelevant to the task of interest, and discard relevant information. Past work has addressed this limitation via handcrafted data augmentations that eliminate the shortcut. But, manually crafted augmentations do not work across all datasets and tasks. Further, data augmentations fail in addressing shortcuts in multi-attribute classification when one attribute acts as a shortcut around other attributes. In this paper, we analyze the objective function of contrastive learning and formally prove that it is vulnerable to shortcuts. We then present reconstructive contrastive learning (RCL), a framework for learning unsupervised representations that are robust to shortcuts. The key idea is to force the learned representation to reconstruct the input, which naturally counters potential shortcuts. Extensive experiments verify that RCL is highly robust to shortcuts and outperforms state-of-the-art contrastive learning methods on a variety of datasets and tasks." @default.
- W3189743387 created "2021-08-16" @default.
- W3189743387 creator A5011540763 @default.
- W3189743387 creator A5040942912 @default.
- W3189743387 creator A5043729517 @default.
- W3189743387 creator A5052325109 @default.
- W3189743387 creator A5052959289 @default.
- W3189743387 creator A5077391276 @default.
- W3189743387 creator A5085958820 @default.
- W3189743387 date "2020-12-17" @default.
- W3189743387 modified "2023-09-27" @default.
- W3189743387 title "Making Contrastive Learning Robust to Shortcuts" @default.
- W3189743387 cites W2080873731 @default.
- W3189743387 cites W2100495367 @default.
- W3189743387 cites W2187089797 @default.
- W3189743387 cites W2321533354 @default.
- W3189743387 cites W2525771685 @default.
- W3189743387 cites W2598240396 @default.
- W3189743387 cites W2740222873 @default.
- W3189743387 cites W2789648429 @default.
- W3189743387 cites W2799062425 @default.
- W3189743387 cites W2842286043 @default.
- W3189743387 cites W2962742544 @default.
- W3189743387 cites W2963402313 @default.
- W3189743387 cites W2979579363 @default.
- W3189743387 cites W2981356320 @default.
- W3189743387 cites W2990640172 @default.
- W3189743387 cites W2997932427 @default.
- W3189743387 cites W2998388430 @default.
- W3189743387 cites W3005680577 @default.
- W3189743387 cites W3034781633 @default.
- W3189743387 cites W3035216422 @default.
- W3189743387 cites W3036982689 @default.
- W3189743387 cites W343636949 @default.
- W3189743387 hasPublicationYear "2020" @default.
- W3189743387 type Work @default.
- W3189743387 sameAs 3189743387 @default.
- W3189743387 citedByCount "2" @default.
- W3189743387 countsByYear W31897433872021 @default.
- W3189743387 crossrefType "posted-content" @default.
- W3189743387 hasAuthorship W3189743387A5011540763 @default.
- W3189743387 hasAuthorship W3189743387A5040942912 @default.
- W3189743387 hasAuthorship W3189743387A5043729517 @default.
- W3189743387 hasAuthorship W3189743387A5052325109 @default.
- W3189743387 hasAuthorship W3189743387A5052959289 @default.
- W3189743387 hasAuthorship W3189743387A5077391276 @default.
- W3189743387 hasAuthorship W3189743387A5085958820 @default.
- W3189743387 hasConcept C119857082 @default.
- W3189743387 hasConcept C136197465 @default.
- W3189743387 hasConcept C14036430 @default.
- W3189743387 hasConcept C154945302 @default.
- W3189743387 hasConcept C162324750 @default.
- W3189743387 hasConcept C17744445 @default.
- W3189743387 hasConcept C187736073 @default.
- W3189743387 hasConcept C199539241 @default.
- W3189743387 hasConcept C204321447 @default.
- W3189743387 hasConcept C26517878 @default.
- W3189743387 hasConcept C2776359362 @default.
- W3189743387 hasConcept C2780451532 @default.
- W3189743387 hasConcept C38652104 @default.
- W3189743387 hasConcept C41008148 @default.
- W3189743387 hasConcept C59404180 @default.
- W3189743387 hasConcept C78458016 @default.
- W3189743387 hasConcept C86803240 @default.
- W3189743387 hasConcept C94625758 @default.
- W3189743387 hasConceptScore W3189743387C119857082 @default.
- W3189743387 hasConceptScore W3189743387C136197465 @default.
- W3189743387 hasConceptScore W3189743387C14036430 @default.
- W3189743387 hasConceptScore W3189743387C154945302 @default.
- W3189743387 hasConceptScore W3189743387C162324750 @default.
- W3189743387 hasConceptScore W3189743387C17744445 @default.
- W3189743387 hasConceptScore W3189743387C187736073 @default.
- W3189743387 hasConceptScore W3189743387C199539241 @default.
- W3189743387 hasConceptScore W3189743387C204321447 @default.
- W3189743387 hasConceptScore W3189743387C26517878 @default.
- W3189743387 hasConceptScore W3189743387C2776359362 @default.
- W3189743387 hasConceptScore W3189743387C2780451532 @default.
- W3189743387 hasConceptScore W3189743387C38652104 @default.
- W3189743387 hasConceptScore W3189743387C41008148 @default.
- W3189743387 hasConceptScore W3189743387C59404180 @default.
- W3189743387 hasConceptScore W3189743387C78458016 @default.
- W3189743387 hasConceptScore W3189743387C86803240 @default.
- W3189743387 hasConceptScore W3189743387C94625758 @default.
- W3189743387 hasLocation W31897433871 @default.
- W3189743387 hasOpenAccess W3189743387 @default.
- W3189743387 hasPrimaryLocation W31897433871 @default.
- W3189743387 hasRelatedWork W2153152620 @default.
- W3189743387 hasRelatedWork W2742485676 @default.
- W3189743387 hasRelatedWork W2914515968 @default.
- W3189743387 hasRelatedWork W2969666864 @default.
- W3189743387 hasRelatedWork W2972335934 @default.
- W3189743387 hasRelatedWork W2992306696 @default.
- W3189743387 hasRelatedWork W3088282579 @default.
- W3189743387 hasRelatedWork W3100609281 @default.
- W3189743387 hasRelatedWork W3102950138 @default.
- W3189743387 hasRelatedWork W3122230582 @default.
- W3189743387 hasRelatedWork W3130429453 @default.
- W3189743387 hasRelatedWork W3133849783 @default.
- W3189743387 hasRelatedWork W3153186148 @default.
- W3189743387 hasRelatedWork W3165998135 @default.