Matches in SemOpenAlex for { <https://semopenalex.org/work/W3100177535> ?p ?o ?g. }
- W3100177535 abstract "Self-supervised representation learning has seen remarkable progress in the last few years. More recently, contrastive instance learning has shown impressive results compared to its supervised learning counterparts, in particular on downstream tasks like image classification and object detection. However, even with the ever increased interest in contrastive instance learning, it is still largely unclear why these methods work so well. In this paper, we aim to unravel some of the mysteries behind their success, which are the good practices. In particular, we investigate why the nonlinear projection head is essential, why instance discrimination does not suffer from strong data augmentation, and if large amounts of negative samples are required during contrastive loss computation. Through an extensive empirical analysis, we hope to not only provide insights but also lay out a set of best practices that led to the success of recent work in self-supervised representation learning." @default.
- W3100177535 created "2020-11-23" @default.
- W3100177535 creator A5003062075 @default.
- W3100177535 creator A5058457237 @default.
- W3100177535 creator A5060014350 @default.
- W3100177535 creator A5073183598 @default.
- W3100177535 date "2021-05-04" @default.
- W3100177535 modified "2023-09-27" @default.
- W3100177535 title "Towards Good Practices in Self-Supervised Representation Learning" @default.
- W3100177535 cites W1520997877 @default.
- W3100177535 cites W2148349024 @default.
- W3100177535 cites W2163605009 @default.
- W3100177535 cites W2187089797 @default.
- W3100177535 cites W2321533354 @default.
- W3100177535 cites W2326925005 @default.
- W3100177535 cites W2412320034 @default.
- W3100177535 cites W2746314669 @default.
- W3100177535 cites W2750549109 @default.
- W3100177535 cites W2798991696 @default.
- W3100177535 cites W2842511635 @default.
- W3100177535 cites W2883725317 @default.
- W3100177535 cites W2949517790 @default.
- W3100177535 cites W2949736877 @default.
- W3100177535 cites W2962742544 @default.
- W3100177535 cites W2963420272 @default.
- W3100177535 cites W2971155163 @default.
- W3100177535 cites W3009561768 @default.
- W3100177535 cites W3034781633 @default.
- W3100177535 cites W3034978746 @default.
- W3100177535 cites W3035060554 @default.
- W3100177535 cites W3035524453 @default.
- W3100177535 cites W3036224891 @default.
- W3100177535 cites W3046208551 @default.
- W3100177535 cites W3100345210 @default.
- W3100177535 cites W343636949 @default.
- W3100177535 hasPublicationYear "2021" @default.
- W3100177535 type Work @default.
- W3100177535 sameAs 3100177535 @default.
- W3100177535 citedByCount "0" @default.
- W3100177535 crossrefType "journal-article" @default.
- W3100177535 hasAuthorship W3100177535A5003062075 @default.
- W3100177535 hasAuthorship W3100177535A5058457237 @default.
- W3100177535 hasAuthorship W3100177535A5060014350 @default.
- W3100177535 hasAuthorship W3100177535A5073183598 @default.
- W3100177535 hasConcept C11413529 @default.
- W3100177535 hasConcept C119857082 @default.
- W3100177535 hasConcept C136389625 @default.
- W3100177535 hasConcept C153180895 @default.
- W3100177535 hasConcept C154945302 @default.
- W3100177535 hasConcept C177264268 @default.
- W3100177535 hasConcept C17744445 @default.
- W3100177535 hasConcept C199360897 @default.
- W3100177535 hasConcept C199539241 @default.
- W3100177535 hasConcept C204321447 @default.
- W3100177535 hasConcept C2776359362 @default.
- W3100177535 hasConcept C2781238097 @default.
- W3100177535 hasConcept C41008148 @default.
- W3100177535 hasConcept C50644808 @default.
- W3100177535 hasConcept C57493831 @default.
- W3100177535 hasConcept C58973888 @default.
- W3100177535 hasConcept C59404180 @default.
- W3100177535 hasConcept C94625758 @default.
- W3100177535 hasConceptScore W3100177535C11413529 @default.
- W3100177535 hasConceptScore W3100177535C119857082 @default.
- W3100177535 hasConceptScore W3100177535C136389625 @default.
- W3100177535 hasConceptScore W3100177535C153180895 @default.
- W3100177535 hasConceptScore W3100177535C154945302 @default.
- W3100177535 hasConceptScore W3100177535C177264268 @default.
- W3100177535 hasConceptScore W3100177535C17744445 @default.
- W3100177535 hasConceptScore W3100177535C199360897 @default.
- W3100177535 hasConceptScore W3100177535C199539241 @default.
- W3100177535 hasConceptScore W3100177535C204321447 @default.
- W3100177535 hasConceptScore W3100177535C2776359362 @default.
- W3100177535 hasConceptScore W3100177535C2781238097 @default.
- W3100177535 hasConceptScore W3100177535C41008148 @default.
- W3100177535 hasConceptScore W3100177535C50644808 @default.
- W3100177535 hasConceptScore W3100177535C57493831 @default.
- W3100177535 hasConceptScore W3100177535C58973888 @default.
- W3100177535 hasConceptScore W3100177535C59404180 @default.
- W3100177535 hasConceptScore W3100177535C94625758 @default.
- W3100177535 hasLocation W31001775351 @default.
- W3100177535 hasOpenAccess W3100177535 @default.
- W3100177535 hasPrimaryLocation W31001775351 @default.
- W3100177535 hasRelatedWork W2138857742 @default.
- W3100177535 hasRelatedWork W2898387785 @default.
- W3100177535 hasRelatedWork W2913939497 @default.
- W3100177535 hasRelatedWork W2943527153 @default.
- W3100177535 hasRelatedWork W2984353870 @default.
- W3100177535 hasRelatedWork W3003387229 @default.
- W3100177535 hasRelatedWork W3087576162 @default.
- W3100177535 hasRelatedWork W3088808810 @default.
- W3100177535 hasRelatedWork W3093222659 @default.
- W3100177535 hasRelatedWork W3114632476 @default.
- W3100177535 hasRelatedWork W3119521703 @default.
- W3100177535 hasRelatedWork W3123072794 @default.
- W3100177535 hasRelatedWork W3128209463 @default.
- W3100177535 hasRelatedWork W3137667808 @default.
- W3100177535 hasRelatedWork W3160314846 @default.
- W3100177535 hasRelatedWork W3171229070 @default.
- W3100177535 hasRelatedWork W3172307065 @default.