FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W4319300833> ?p ?o ?g. }

• W4319300833 abstract "State-of-the-art frameworks in self-supervised learning have recently shown that fully utilizing transformer-based models can lead to performance boost compared to conventional CNN models. Striving to maximize the mutual information of two views of an image, existing works apply a contrastive loss to the final representations. Motivated by self-distillation in the supervised regime, we further exploit this by allowing the intermediate representations to learn from the final layer via the contrastive loss. Through self-distillation, the intermediate layers are better suited for instance discrimination, making the performance of an early-exited sub-network not much degraded from that of the full network. This renders the pretext task easier also for the final layer, leading to better representations. Our method, Self-Distilled Self-Supervised Learning (SDSSL), outperforms competitive baselines (SimCLR, BYOL and MoCo v3) using ViT on various tasks and datasets. In the linear evaluation and k-NN protocol, SDSSL not only leads to superior performance in the final layers, but also in most of the lower layers. Furthermore, qualitative and quantitative analyses show how representations are formed more effectively along the transformer layers. Code is available at https://github.com/hagiss/SDSSL." @default.
• W4319300833 created "2023-02-07" @default.
• W4319300833 creator A5021840542 @default.
• W4319300833 creator A5038612161 @default.
• W4319300833 creator A5064869475 @default.
• W4319300833 creator A5074026358 @default.
• W4319300833 creator A5078656022 @default.
• W4319300833 creator A5084897975 @default.
• W4319300833 date "2023-01-01" @default.
• W4319300833 modified "2023-10-18" @default.
• W4319300833 title "Self-Distilled Self-supervised Representation Learning" @default.
• W4319300833 cites W1954152232 @default.
• W4319300833 cites W1977295328 @default.
• W4319300833 cites W2020308406 @default.
• W4319300833 cites W2108598243 @default.
• W4319300833 cites W2138011018 @default.
• W4319300833 cites W2148809531 @default.
• W4319300833 cites W2250384498 @default.
• W4319300833 cites W2533598788 @default.
• W4319300833 cites W2798991696 @default.
• W4319300833 cites W2954054736 @default.
• W4319300833 cites W2963588253 @default.
• W4319300833 cites W2964189064 @default.
• W4319300833 cites W2981884310 @default.
• W4319300833 cites W2987861506 @default.
• W4319300833 cites W2988614387 @default.
• W4319300833 cites W3035524453 @default.
• W4319300833 cites W3103274847 @default.
• W4319300833 cites W3158714121 @default.
• W4319300833 cites W3159481202 @default.
• W4319300833 cites W3171007011 @default.
• W4319300833 doi "https://doi.org/10.1109/wacv56688.2023.00285" @default.
• W4319300833 hasPublicationYear "2023" @default.
• W4319300833 type Work @default.
• W4319300833 citedByCount "0" @default.
• W4319300833 crossrefType "proceedings-article" @default.
• W4319300833 hasAuthorship W4319300833A5021840542 @default.
• W4319300833 hasAuthorship W4319300833A5038612161 @default.
• W4319300833 hasAuthorship W4319300833A5064869475 @default.
• W4319300833 hasAuthorship W4319300833A5074026358 @default.
• W4319300833 hasAuthorship W4319300833A5078656022 @default.
• W4319300833 hasAuthorship W4319300833A5084897975 @default.
• W4319300833 hasBestOaLocation W43193008332 @default.
• W4319300833 hasConcept C119857082 @default.
• W4319300833 hasConcept C121332964 @default.
• W4319300833 hasConcept C153180895 @default.
• W4319300833 hasConcept C154945302 @default.
• W4319300833 hasConcept C165696696 @default.
• W4319300833 hasConcept C165801399 @default.
• W4319300833 hasConcept C177264268 @default.
• W4319300833 hasConcept C17744445 @default.
• W4319300833 hasConcept C178790620 @default.
• W4319300833 hasConcept C185592680 @default.
• W4319300833 hasConcept C199360897 @default.
• W4319300833 hasConcept C199539241 @default.
• W4319300833 hasConcept C204030448 @default.
• W4319300833 hasConcept C2776359362 @default.
• W4319300833 hasConcept C2776760102 @default.
• W4319300833 hasConcept C38652104 @default.
• W4319300833 hasConcept C41008148 @default.
• W4319300833 hasConcept C59404180 @default.
• W4319300833 hasConcept C62520636 @default.
• W4319300833 hasConcept C66322947 @default.
• W4319300833 hasConcept C94625758 @default.
• W4319300833 hasConceptScore W4319300833C119857082 @default.
• W4319300833 hasConceptScore W4319300833C121332964 @default.
• W4319300833 hasConceptScore W4319300833C153180895 @default.
• W4319300833 hasConceptScore W4319300833C154945302 @default.
• W4319300833 hasConceptScore W4319300833C165696696 @default.
• W4319300833 hasConceptScore W4319300833C165801399 @default.
• W4319300833 hasConceptScore W4319300833C177264268 @default.
• W4319300833 hasConceptScore W4319300833C17744445 @default.
• W4319300833 hasConceptScore W4319300833C178790620 @default.
• W4319300833 hasConceptScore W4319300833C185592680 @default.
• W4319300833 hasConceptScore W4319300833C199360897 @default.
• W4319300833 hasConceptScore W4319300833C199539241 @default.
• W4319300833 hasConceptScore W4319300833C204030448 @default.
• W4319300833 hasConceptScore W4319300833C2776359362 @default.
• W4319300833 hasConceptScore W4319300833C2776760102 @default.
• W4319300833 hasConceptScore W4319300833C38652104 @default.
• W4319300833 hasConceptScore W4319300833C41008148 @default.
• W4319300833 hasConceptScore W4319300833C59404180 @default.
• W4319300833 hasConceptScore W4319300833C62520636 @default.
• W4319300833 hasConceptScore W4319300833C66322947 @default.
• W4319300833 hasConceptScore W4319300833C94625758 @default.
• W4319300833 hasLocation W43193008331 @default.
• W4319300833 hasLocation W43193008332 @default.
• W4319300833 hasOpenAccess W4319300833 @default.
• W4319300833 hasPrimaryLocation W43193008331 @default.
• W4319300833 hasRelatedWork W2592385986 @default.
• W4319300833 hasRelatedWork W2608244370 @default.
• W4319300833 hasRelatedWork W2743674619 @default.
• W4319300833 hasRelatedWork W2775464024 @default.
• W4319300833 hasRelatedWork W2775465319 @default.
• W4319300833 hasRelatedWork W2905846897 @default.
• W4319300833 hasRelatedWork W2998168123 @default.
• W4319300833 hasRelatedWork W3098057481 @default.
• W4319300833 hasRelatedWork W4285606578 @default.
• W4319300833 hasRelatedWork W4287995534 @default.
• W4319300833 isParatext "false" @default.

• next