Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287255140> ?p ?o ?g. }
Showing items 1 to 69 of
69
with 100 items per page.
- W4287255140 abstract "Tremendous progress has been made in visual representation learning, notably with the recent success of self-supervised contrastive learning methods. Supervised contrastive learning has also been shown to outperform its cross-entropy counterparts by leveraging labels for choosing where to contrast. However, there has been little work to explore the transfer capability of contrastive learning to a different domain. In this paper, we conduct a comprehensive study on the transferability of learned representations of different contrastive approaches for linear evaluation, full-network transfer, and few-shot recognition on 12 downstream datasets from different domains, and object detection tasks on MSCOCO and VOC0712. The results show that the contrastive approaches learn representations that are easily transferable to a different downstream task. We further observe that the joint objective of self-supervised contrastive loss with cross-entropy/supervised-contrastive loss leads to better transferability of these models over their supervised counterparts. Our analysis reveals that the representations learned from the contrastive approaches contain more low/mid-level semantics than cross-entropy models, which enables them to quickly adapt to a new task. Our codes and models will be publicly available to facilitate future research on transferability of visual representations." @default.
- W4287255140 created "2022-07-25" @default.
- W4287255140 creator A5020676344 @default.
- W4287255140 creator A5049207791 @default.
- W4287255140 creator A5049734237 @default.
- W4287255140 creator A5052325109 @default.
- W4287255140 creator A5079442652 @default.
- W4287255140 creator A5080417608 @default.
- W4287255140 date "2021-03-24" @default.
- W4287255140 modified "2023-09-26" @default.
- W4287255140 title "A Broad Study on the Transferability of Visual Representations with Contrastive Learning" @default.
- W4287255140 doi "https://doi.org/10.48550/arxiv.2103.13517" @default.
- W4287255140 hasPublicationYear "2021" @default.
- W4287255140 type Work @default.
- W4287255140 citedByCount "0" @default.
- W4287255140 crossrefType "posted-content" @default.
- W4287255140 hasAuthorship W4287255140A5020676344 @default.
- W4287255140 hasAuthorship W4287255140A5049207791 @default.
- W4287255140 hasAuthorship W4287255140A5049734237 @default.
- W4287255140 hasAuthorship W4287255140A5052325109 @default.
- W4287255140 hasAuthorship W4287255140A5079442652 @default.
- W4287255140 hasAuthorship W4287255140A5080417608 @default.
- W4287255140 hasBestOaLocation W42872551401 @default.
- W4287255140 hasConcept C106301342 @default.
- W4287255140 hasConcept C119857082 @default.
- W4287255140 hasConcept C121332964 @default.
- W4287255140 hasConcept C138885662 @default.
- W4287255140 hasConcept C140331021 @default.
- W4287255140 hasConcept C150899416 @default.
- W4287255140 hasConcept C153180895 @default.
- W4287255140 hasConcept C154945302 @default.
- W4287255140 hasConcept C167981619 @default.
- W4287255140 hasConcept C204321447 @default.
- W4287255140 hasConcept C2777629044 @default.
- W4287255140 hasConcept C41008148 @default.
- W4287255140 hasConcept C41895202 @default.
- W4287255140 hasConcept C61272859 @default.
- W4287255140 hasConcept C62520636 @default.
- W4287255140 hasConceptScore W4287255140C106301342 @default.
- W4287255140 hasConceptScore W4287255140C119857082 @default.
- W4287255140 hasConceptScore W4287255140C121332964 @default.
- W4287255140 hasConceptScore W4287255140C138885662 @default.
- W4287255140 hasConceptScore W4287255140C140331021 @default.
- W4287255140 hasConceptScore W4287255140C150899416 @default.
- W4287255140 hasConceptScore W4287255140C153180895 @default.
- W4287255140 hasConceptScore W4287255140C154945302 @default.
- W4287255140 hasConceptScore W4287255140C167981619 @default.
- W4287255140 hasConceptScore W4287255140C204321447 @default.
- W4287255140 hasConceptScore W4287255140C2777629044 @default.
- W4287255140 hasConceptScore W4287255140C41008148 @default.
- W4287255140 hasConceptScore W4287255140C41895202 @default.
- W4287255140 hasConceptScore W4287255140C61272859 @default.
- W4287255140 hasConceptScore W4287255140C62520636 @default.
- W4287255140 hasLocation W42872551401 @default.
- W4287255140 hasOpenAccess W4287255140 @default.
- W4287255140 hasPrimaryLocation W42872551401 @default.
- W4287255140 hasRelatedWork W2960456850 @default.
- W4287255140 hasRelatedWork W3021430260 @default.
- W4287255140 hasRelatedWork W3090986316 @default.
- W4287255140 hasRelatedWork W3133293092 @default.
- W4287255140 hasRelatedWork W3192503984 @default.
- W4287255140 hasRelatedWork W4213299466 @default.
- W4287255140 hasRelatedWork W4281382123 @default.
- W4287255140 hasRelatedWork W4281645081 @default.
- W4287255140 hasRelatedWork W4287255140 @default.
- W4287255140 hasRelatedWork W4294306704 @default.
- W4287255140 isParatext "false" @default.
- W4287255140 isRetracted "false" @default.
- W4287255140 workType "article" @default.