Matches in SemOpenAlex for { <https://semopenalex.org/work/W3160566314> ?p ?o ?g. }
Showing items 1 to 97 of
97
with 100 items per page.
- W3160566314 abstract "We are witnessing a modeling shift from CNN to Transformers in computer vision. In this work, we present a self-supervised learning approach called MoBY, with Vision Transformers as its backbone architecture. The approach basically has no new inventions, which is combined from MoCo v2 and BYOL and tuned to achieve reasonably high accuracy on ImageNet-1K linear evaluation: 72.8% and 75.0% top-1 accuracy using DeiT-S and Swin-T, respectively, by 300-epoch training. The performance is slightly better than recent works of MoCo v3 and DINO which adopt DeiT as the backbone, but with much lighter tricks. More importantly, the general-purpose Swin Transformer backbone enables us to also evaluate the learnt representations on downstream tasks such as object detection and semantic segmentation, in contrast to a few recent approaches built on ViT/DeiT which only report linear evaluation results on ImageNet-1K due to ViT/DeiT not tamed for these dense prediction tasks. We hope our results can facilitate more comprehensive evaluation of self-supervised learning methods designed for Transformer architectures. Our code and models are available at this https URL, which will be continually enriched." @default.
- W3160566314 created "2021-05-24" @default.
- W3160566314 creator A5008754580 @default.
- W3160566314 creator A5012287052 @default.
- W3160566314 creator A5014838804 @default.
- W3160566314 creator A5028650738 @default.
- W3160566314 creator A5029901095 @default.
- W3160566314 creator A5084464680 @default.
- W3160566314 creator A5088888083 @default.
- W3160566314 date "2021-05-10" @default.
- W3160566314 modified "2023-09-23" @default.
- W3160566314 title "Self-Supervised Learning with Swin Transformers" @default.
- W3160566314 cites W1522301498 @default.
- W3160566314 cites W2194775991 @default.
- W3160566314 cites W2599765304 @default.
- W3160566314 cites W2884822772 @default.
- W3160566314 cites W2950541952 @default.
- W3160566314 cites W2963403868 @default.
- W3160566314 cites W2964241181 @default.
- W3160566314 cites W3005680577 @default.
- W3160566314 cites W3009561768 @default.
- W3160566314 cites W3035060554 @default.
- W3160566314 cites W3035524453 @default.
- W3160566314 cites W3094502228 @default.
- W3160566314 cites W3116489684 @default.
- W3160566314 cites W3135958856 @default.
- W3160566314 cites W3138516171 @default.
- W3160566314 cites W3145450063 @default.
- W3160566314 cites W3159481202 @default.
- W3160566314 cites W3172615411 @default.
- W3160566314 hasPublicationYear "2021" @default.
- W3160566314 type Work @default.
- W3160566314 sameAs 3160566314 @default.
- W3160566314 citedByCount "14" @default.
- W3160566314 countsByYear W31605663142020 @default.
- W3160566314 countsByYear W31605663142021 @default.
- W3160566314 crossrefType "posted-content" @default.
- W3160566314 hasAuthorship W3160566314A5008754580 @default.
- W3160566314 hasAuthorship W3160566314A5012287052 @default.
- W3160566314 hasAuthorship W3160566314A5014838804 @default.
- W3160566314 hasAuthorship W3160566314A5028650738 @default.
- W3160566314 hasAuthorship W3160566314A5029901095 @default.
- W3160566314 hasAuthorship W3160566314A5084464680 @default.
- W3160566314 hasAuthorship W3160566314A5088888083 @default.
- W3160566314 hasConcept C119599485 @default.
- W3160566314 hasConcept C119857082 @default.
- W3160566314 hasConcept C123657996 @default.
- W3160566314 hasConcept C127413603 @default.
- W3160566314 hasConcept C136389625 @default.
- W3160566314 hasConcept C142362112 @default.
- W3160566314 hasConcept C153349607 @default.
- W3160566314 hasConcept C154945302 @default.
- W3160566314 hasConcept C165801399 @default.
- W3160566314 hasConcept C41008148 @default.
- W3160566314 hasConcept C50644808 @default.
- W3160566314 hasConcept C66322947 @default.
- W3160566314 hasConcept C89600930 @default.
- W3160566314 hasConceptScore W3160566314C119599485 @default.
- W3160566314 hasConceptScore W3160566314C119857082 @default.
- W3160566314 hasConceptScore W3160566314C123657996 @default.
- W3160566314 hasConceptScore W3160566314C127413603 @default.
- W3160566314 hasConceptScore W3160566314C136389625 @default.
- W3160566314 hasConceptScore W3160566314C142362112 @default.
- W3160566314 hasConceptScore W3160566314C153349607 @default.
- W3160566314 hasConceptScore W3160566314C154945302 @default.
- W3160566314 hasConceptScore W3160566314C165801399 @default.
- W3160566314 hasConceptScore W3160566314C41008148 @default.
- W3160566314 hasConceptScore W3160566314C50644808 @default.
- W3160566314 hasConceptScore W3160566314C66322947 @default.
- W3160566314 hasConceptScore W3160566314C89600930 @default.
- W3160566314 hasLocation W31605663141 @default.
- W3160566314 hasOpenAccess W3160566314 @default.
- W3160566314 hasPrimaryLocation W31605663141 @default.
- W3160566314 hasRelatedWork W1861492603 @default.
- W3160566314 hasRelatedWork W2108598243 @default.
- W3160566314 hasRelatedWork W2194775991 @default.
- W3160566314 hasRelatedWork W2321533354 @default.
- W3160566314 hasRelatedWork W2326925005 @default.
- W3160566314 hasRelatedWork W2565639579 @default.
- W3160566314 hasRelatedWork W2842511635 @default.
- W3160566314 hasRelatedWork W2962742544 @default.
- W3160566314 hasRelatedWork W2963341956 @default.
- W3160566314 hasRelatedWork W2963403868 @default.
- W3160566314 hasRelatedWork W2965373594 @default.
- W3160566314 hasRelatedWork W3005680577 @default.
- W3160566314 hasRelatedWork W3009561768 @default.
- W3160566314 hasRelatedWork W3034445277 @default.
- W3160566314 hasRelatedWork W3035524453 @default.
- W3160566314 hasRelatedWork W3116489684 @default.
- W3160566314 hasRelatedWork W3119786062 @default.
- W3160566314 hasRelatedWork W3138516171 @default.
- W3160566314 hasRelatedWork W3145450063 @default.
- W3160566314 hasRelatedWork W3170841864 @default.
- W3160566314 isParatext "false" @default.
- W3160566314 isRetracted "false" @default.
- W3160566314 magId "3160566314" @default.
- W3160566314 workType "article" @default.