Matches in SemOpenAlex for { <https://semopenalex.org/work/W3185678184> ?p ?o ?g. }
- W3185678184 abstract "Contrastive self-supervised learning (SSL) has achieved great success in unsupervised visual representation learning by maximizing the similarity between two augmented views of the same image (positive pairs) and simultaneously contrasting other different images (negative pairs). However, this type of methods, such as SimCLR and MoCo, relies heavily on a large number of negative pairs and thus requires either large batches or memory banks. In contrast, some recent non-contrastive SSL methods, such as BYOL and SimSiam, attempt to discard negative pairs by introducing asymmetry and show remarkable performance. Unfortunately, to avoid collapsed solutions caused by not using negative pairs, these methods require sophisticated asymmetry designs. In this paper, we argue that negative pairs are still necessary but one is sufficient, i.e., triplet is all you need. A simple triplet-based loss can achieve surprisingly good performance without requiring large batches or asymmetry. Moreover, we observe that unsupervised visual representation learning can gain significantly from randomness. Based on this observation, we propose a simple plug-in RandOm MApping (ROMA) strategy by randomly mapping samples into other spaces and enforcing these randomly projected samples to satisfy the same correlation requirement. The proposed ROMA strategy not only achieves the state-of-the-art performance in conjunction with the triplet-based loss, but also can further effectively boost other SSL methods." @default.
- W3185678184 created "2021-08-02" @default.
- W3185678184 creator A5018725339 @default.
- W3185678184 creator A5055469774 @default.
- W3185678184 creator A5059726557 @default.
- W3185678184 creator A5066091819 @default.
- W3185678184 creator A5073216396 @default.
- W3185678184 creator A5074250521 @default.
- W3185678184 creator A5091798976 @default.
- W3185678184 date "2021-07-22" @default.
- W3185678184 modified "2023-09-27" @default.
- W3185678184 title "Triplet is All You Need with Random Mappings for Unsupervised Visual Representation Learning" @default.
- W3185678184 cites W2025768430 @default.
- W3185678184 cites W2106053110 @default.
- W3185678184 cites W2108598243 @default.
- W3185678184 cites W2118858186 @default.
- W3185678184 cites W2138621090 @default.
- W3185678184 cites W2148349024 @default.
- W3185678184 cites W2194775991 @default.
- W3185678184 cites W2321533354 @default.
- W3185678184 cites W2325939864 @default.
- W3185678184 cites W2326925005 @default.
- W3185678184 cites W2798991696 @default.
- W3185678184 cites W2842511635 @default.
- W3185678184 cites W2949117887 @default.
- W3185678184 cites W2949517790 @default.
- W3185678184 cites W2951873722 @default.
- W3185678184 cites W2962742544 @default.
- W3185678184 cites W2963420272 @default.
- W3185678184 cites W2971155163 @default.
- W3185678184 cites W2979579363 @default.
- W3185678184 cites W3009561768 @default.
- W3185678184 cites W3034781633 @default.
- W3185678184 cites W3034978746 @default.
- W3185678184 cites W3035058308 @default.
- W3185678184 cites W3035524453 @default.
- W3185678184 cites W3091905774 @default.
- W3185678184 cites W3095121901 @default.
- W3185678184 cites W3101821705 @default.
- W3185678184 cites W3106428938 @default.
- W3185678184 cites W3118608800 @default.
- W3185678184 cites W3134652006 @default.
- W3185678184 cites W3171007011 @default.
- W3185678184 cites W343636949 @default.
- W3185678184 hasPublicationYear "2021" @default.
- W3185678184 type Work @default.
- W3185678184 sameAs 3185678184 @default.
- W3185678184 citedByCount "0" @default.
- W3185678184 crossrefType "posted-content" @default.
- W3185678184 hasAuthorship W3185678184A5018725339 @default.
- W3185678184 hasAuthorship W3185678184A5055469774 @default.
- W3185678184 hasAuthorship W3185678184A5059726557 @default.
- W3185678184 hasAuthorship W3185678184A5066091819 @default.
- W3185678184 hasAuthorship W3185678184A5073216396 @default.
- W3185678184 hasAuthorship W3185678184A5074250521 @default.
- W3185678184 hasAuthorship W3185678184A5091798976 @default.
- W3185678184 hasConcept C103278499 @default.
- W3185678184 hasConcept C105795698 @default.
- W3185678184 hasConcept C111472728 @default.
- W3185678184 hasConcept C115961682 @default.
- W3185678184 hasConcept C121332964 @default.
- W3185678184 hasConcept C125112378 @default.
- W3185678184 hasConcept C138885662 @default.
- W3185678184 hasConcept C153180895 @default.
- W3185678184 hasConcept C154945302 @default.
- W3185678184 hasConcept C17744445 @default.
- W3185678184 hasConcept C199539241 @default.
- W3185678184 hasConcept C2776359362 @default.
- W3185678184 hasConcept C2776502983 @default.
- W3185678184 hasConcept C2780586882 @default.
- W3185678184 hasConcept C33923547 @default.
- W3185678184 hasConcept C38976095 @default.
- W3185678184 hasConcept C41008148 @default.
- W3185678184 hasConcept C62520636 @default.
- W3185678184 hasConcept C8038995 @default.
- W3185678184 hasConcept C80444323 @default.
- W3185678184 hasConcept C94625758 @default.
- W3185678184 hasConceptScore W3185678184C103278499 @default.
- W3185678184 hasConceptScore W3185678184C105795698 @default.
- W3185678184 hasConceptScore W3185678184C111472728 @default.
- W3185678184 hasConceptScore W3185678184C115961682 @default.
- W3185678184 hasConceptScore W3185678184C121332964 @default.
- W3185678184 hasConceptScore W3185678184C125112378 @default.
- W3185678184 hasConceptScore W3185678184C138885662 @default.
- W3185678184 hasConceptScore W3185678184C153180895 @default.
- W3185678184 hasConceptScore W3185678184C154945302 @default.
- W3185678184 hasConceptScore W3185678184C17744445 @default.
- W3185678184 hasConceptScore W3185678184C199539241 @default.
- W3185678184 hasConceptScore W3185678184C2776359362 @default.
- W3185678184 hasConceptScore W3185678184C2776502983 @default.
- W3185678184 hasConceptScore W3185678184C2780586882 @default.
- W3185678184 hasConceptScore W3185678184C33923547 @default.
- W3185678184 hasConceptScore W3185678184C38976095 @default.
- W3185678184 hasConceptScore W3185678184C41008148 @default.
- W3185678184 hasConceptScore W3185678184C62520636 @default.
- W3185678184 hasConceptScore W3185678184C8038995 @default.
- W3185678184 hasConceptScore W3185678184C80444323 @default.
- W3185678184 hasConceptScore W3185678184C94625758 @default.
- W3185678184 hasLocation W31856781841 @default.
- W3185678184 hasOpenAccess W3185678184 @default.