Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287551759> ?p ?o ?g. }
Showing items 1 to 64 of
64
with 100 items per page.
- W4287551759 abstract "Recently, contrastive learning has achieved great results in self-supervised learning, where the main idea is to push two augmentations of an image (positive pairs) closer compared to other random images (negative pairs). We argue that not all random images are equal. Hence, we introduce a self supervised learning algorithm where we use a soft similarity for the negative images rather than a binary distinction between positive and negative pairs. We iteratively distill a slowly evolving teacher model to the student model by capturing the similarity of a query image to some random images and transferring that knowledge to the student. We argue that our method is less constrained compared to recent contrastive learning methods, so it can learn better features. Specifically, our method should handle unbalanced and unlabeled data better than existing contrastive learning methods, because the randomly chosen negative set might include many samples that are semantically similar to the query image. In this case, our method labels them as highly similar while standard contrastive methods label them as negative pairs. Our method achieves comparable results to the state-of-the-art models. We also show that our method performs better in the settings where the unlabeled data is unbalanced. Our code is available here: https://github.com/UMBCvision/ISD." @default.
- W4287551759 created "2022-07-25" @default.
- W4287551759 creator A5031794370 @default.
- W4287551759 creator A5031860916 @default.
- W4287551759 creator A5070940574 @default.
- W4287551759 creator A5072056465 @default.
- W4287551759 creator A5084289151 @default.
- W4287551759 date "2020-12-16" @default.
- W4287551759 modified "2023-09-27" @default.
- W4287551759 title "ISD: Self-Supervised Learning by Iterative Similarity Distillation" @default.
- W4287551759 doi "https://doi.org/10.48550/arxiv.2012.09259" @default.
- W4287551759 hasPublicationYear "2020" @default.
- W4287551759 type Work @default.
- W4287551759 citedByCount "0" @default.
- W4287551759 crossrefType "posted-content" @default.
- W4287551759 hasAuthorship W4287551759A5031794370 @default.
- W4287551759 hasAuthorship W4287551759A5031860916 @default.
- W4287551759 hasAuthorship W4287551759A5070940574 @default.
- W4287551759 hasAuthorship W4287551759A5072056465 @default.
- W4287551759 hasAuthorship W4287551759A5084289151 @default.
- W4287551759 hasBestOaLocation W42875517591 @default.
- W4287551759 hasConcept C103278499 @default.
- W4287551759 hasConcept C115961682 @default.
- W4287551759 hasConcept C119857082 @default.
- W4287551759 hasConcept C153180895 @default.
- W4287551759 hasConcept C154945302 @default.
- W4287551759 hasConcept C177264268 @default.
- W4287551759 hasConcept C199360897 @default.
- W4287551759 hasConcept C204321447 @default.
- W4287551759 hasConcept C2776760102 @default.
- W4287551759 hasConcept C33923547 @default.
- W4287551759 hasConcept C41008148 @default.
- W4287551759 hasConcept C48372109 @default.
- W4287551759 hasConcept C94375191 @default.
- W4287551759 hasConceptScore W4287551759C103278499 @default.
- W4287551759 hasConceptScore W4287551759C115961682 @default.
- W4287551759 hasConceptScore W4287551759C119857082 @default.
- W4287551759 hasConceptScore W4287551759C153180895 @default.
- W4287551759 hasConceptScore W4287551759C154945302 @default.
- W4287551759 hasConceptScore W4287551759C177264268 @default.
- W4287551759 hasConceptScore W4287551759C199360897 @default.
- W4287551759 hasConceptScore W4287551759C204321447 @default.
- W4287551759 hasConceptScore W4287551759C2776760102 @default.
- W4287551759 hasConceptScore W4287551759C33923547 @default.
- W4287551759 hasConceptScore W4287551759C41008148 @default.
- W4287551759 hasConceptScore W4287551759C48372109 @default.
- W4287551759 hasConceptScore W4287551759C94375191 @default.
- W4287551759 hasLocation W42875517591 @default.
- W4287551759 hasLocation W42875517592 @default.
- W4287551759 hasOpenAccess W4287551759 @default.
- W4287551759 hasPrimaryLocation W42875517591 @default.
- W4287551759 hasRelatedWork W2015538044 @default.
- W4287551759 hasRelatedWork W2038246283 @default.
- W4287551759 hasRelatedWork W2810523766 @default.
- W4287551759 hasRelatedWork W2900794075 @default.
- W4287551759 hasRelatedWork W3107474891 @default.
- W4287551759 hasRelatedWork W3183633970 @default.
- W4287551759 hasRelatedWork W3208309985 @default.
- W4287551759 hasRelatedWork W4281690070 @default.
- W4287551759 hasRelatedWork W4289653936 @default.
- W4287551759 hasRelatedWork W2164844972 @default.
- W4287551759 isParatext "false" @default.
- W4287551759 isRetracted "false" @default.
- W4287551759 workType "article" @default.