Matches in SemOpenAlex for { <https://semopenalex.org/work/W3114848507> ?p ?o ?g. }
- W3114848507 abstract "Contrastive learning is very effective at learning useful representations without supervision. Yet contrastive learning has its limitations. It may learn a shortcut that is irrelevant to the downstream task, and discard relevant information. Past work has addressed this limitation via custom data augmentations that eliminate the shortcut. This solution however does not work for data modalities that are not interpretable by humans, e.g., radio signals. For such modalities, it is hard for a human to guess which shortcuts may exist in the signal, or how they can be eliminated. Even for interpretable data, sometimes eliminating the shortcut may be undesirable. The shortcut may be irrelevant to one downstream task but important to another. In this case, it is desirable to learn a representation that captures both the shortcut information and the information relevant to the other downstream task. This paper presents information-preserving contrastive learning (IPCL), a new framework for unsupervised representation learning that preserves relevant information even in the presence of shortcuts. We empirically show that the representations learned by IPCL outperforms contrastive learning in supporting different modalities and multiple diverse downstream tasks." @default.
- W3114848507 created "2021-01-05" @default.
- W3114848507 creator A5011540763 @default.
- W3114848507 creator A5040942912 @default.
- W3114848507 creator A5043729517 @default.
- W3114848507 creator A5052959289 @default.
- W3114848507 creator A5077391276 @default.
- W3114848507 creator A5085958820 @default.
- W3114848507 date "2020-12-17" @default.
- W3114848507 modified "2023-09-27" @default.
- W3114848507 title "Information-Preserving Contrastive Learning for Self-Supervised Representations." @default.
- W3114848507 cites W2025768430 @default.
- W3114848507 cites W2080873731 @default.
- W3114848507 cites W2100495367 @default.
- W3114848507 cites W2108598243 @default.
- W3114848507 cites W2152790380 @default.
- W3114848507 cites W2187089797 @default.
- W3114848507 cites W2321533354 @default.
- W3114848507 cites W2326925005 @default.
- W3114848507 cites W2342877626 @default.
- W3114848507 cites W2525771685 @default.
- W3114848507 cites W2598240396 @default.
- W3114848507 cites W2740222873 @default.
- W3114848507 cites W2755937803 @default.
- W3114848507 cites W2789648429 @default.
- W3114848507 cites W2798991696 @default.
- W3114848507 cites W2799062425 @default.
- W3114848507 cites W2842286043 @default.
- W3114848507 cites W2842511635 @default.
- W3114848507 cites W2933502442 @default.
- W3114848507 cites W2935908327 @default.
- W3114848507 cites W2944828972 @default.
- W3114848507 cites W2948012107 @default.
- W3114848507 cites W2949517790 @default.
- W3114848507 cites W2951326654 @default.
- W3114848507 cites W2951873722 @default.
- W3114848507 cites W2962742544 @default.
- W3114848507 cites W2963402313 @default.
- W3114848507 cites W2964420626 @default.
- W3114848507 cites W2967013449 @default.
- W3114848507 cites W2974164364 @default.
- W3114848507 cites W2990500698 @default.
- W3114848507 cites W2990640172 @default.
- W3114848507 cites W2997932427 @default.
- W3114848507 cites W3005680577 @default.
- W3114848507 cites W3009561768 @default.
- W3114848507 cites W3026092005 @default.
- W3114848507 cites W3034781633 @default.
- W3114848507 cites W3035060554 @default.
- W3114848507 cites W3035216422 @default.
- W3114848507 cites W3035524453 @default.
- W3114848507 cites W3036224891 @default.
- W3114848507 cites W3036982689 @default.
- W3114848507 cites W3047740097 @default.
- W3114848507 cites W3080993291 @default.
- W3114848507 cites W3096587983 @default.
- W3114848507 cites W3096804376 @default.
- W3114848507 cites W3106875147 @default.
- W3114848507 cites W3107668149 @default.
- W3114848507 cites W3118062200 @default.
- W3114848507 cites W3120167236 @default.
- W3114848507 cites W3155978108 @default.
- W3114848507 cites W343636949 @default.
- W3114848507 hasPublicationYear "2020" @default.
- W3114848507 type Work @default.
- W3114848507 sameAs 3114848507 @default.
- W3114848507 citedByCount "2" @default.
- W3114848507 countsByYear W31148485072021 @default.
- W3114848507 crossrefType "posted-content" @default.
- W3114848507 hasAuthorship W3114848507A5011540763 @default.
- W3114848507 hasAuthorship W3114848507A5040942912 @default.
- W3114848507 hasAuthorship W3114848507A5043729517 @default.
- W3114848507 hasAuthorship W3114848507A5052959289 @default.
- W3114848507 hasAuthorship W3114848507A5077391276 @default.
- W3114848507 hasAuthorship W3114848507A5085958820 @default.
- W3114848507 hasConcept C119857082 @default.
- W3114848507 hasConcept C127413603 @default.
- W3114848507 hasConcept C144024400 @default.
- W3114848507 hasConcept C154945302 @default.
- W3114848507 hasConcept C17744445 @default.
- W3114848507 hasConcept C199539241 @default.
- W3114848507 hasConcept C201995342 @default.
- W3114848507 hasConcept C204321447 @default.
- W3114848507 hasConcept C21547014 @default.
- W3114848507 hasConcept C2776207758 @default.
- W3114848507 hasConcept C2776359362 @default.
- W3114848507 hasConcept C2779903281 @default.
- W3114848507 hasConcept C2780451532 @default.
- W3114848507 hasConcept C36289849 @default.
- W3114848507 hasConcept C41008148 @default.
- W3114848507 hasConcept C59404180 @default.
- W3114848507 hasConcept C94625758 @default.
- W3114848507 hasConceptScore W3114848507C119857082 @default.
- W3114848507 hasConceptScore W3114848507C127413603 @default.
- W3114848507 hasConceptScore W3114848507C144024400 @default.
- W3114848507 hasConceptScore W3114848507C154945302 @default.
- W3114848507 hasConceptScore W3114848507C17744445 @default.
- W3114848507 hasConceptScore W3114848507C199539241 @default.
- W3114848507 hasConceptScore W3114848507C201995342 @default.
- W3114848507 hasConceptScore W3114848507C204321447 @default.