Matches in SemOpenAlex for { <https://semopenalex.org/work/W4313019631> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W4313019631 abstract "Many recent self-supervised frameworks for visual representation learning are based on certain forms of Siamese networks. Such networks are conceptually symmetric with two parallel encoders, but often practically asymmetric as numerous mechanisms are devised to break the symmetry. In this work, we conduct a formal study on the importance of asymmetry by explicitly distinguishing the two encoders within the network - one produces source encodings and the other targets. Our key insight is keeping a relatively lower variance in target than source generally benefits learning. This is empirically justified by our results from five case studies covering different variance-oriented designs, and is aligned with our preliminary theoretical analysis on the baseline. Moreover, we find the improvements from asymmetric designs generalize well to longer training schedules, multiple other frameworks and newer backbones. Finally, the combined effect of several asymmetric designs achieves a state-of-the-art accuracy on ImageNet linear probing and competitive results on downstream transfer. We hope our exploration will inspire more research in exploiting asymmetry for Siamese representation learning." @default.
- W4313019631 created "2023-01-05" @default.
- W4313019631 creator A5016095713 @default.
- W4313019631 creator A5022792966 @default.
- W4313019631 creator A5058010200 @default.
- W4313019631 creator A5062293219 @default.
- W4313019631 creator A5084821923 @default.
- W4313019631 date "2022-06-01" @default.
- W4313019631 modified "2023-10-16" @default.
- W4313019631 title "On the Importance of Asymmetry for Siamese Representation Learning" @default.
- W4313019631 cites W2031489346 @default.
- W4313019631 cites W2145287260 @default.
- W4313019631 cites W2194775991 @default.
- W4313019631 cites W2964155802 @default.
- W4313019631 cites W3034781633 @default.
- W4313019631 cites W3035524453 @default.
- W4313019631 cites W3035682985 @default.
- W4313019631 cites W3159481202 @default.
- W4313019631 cites W3171007011 @default.
- W4313019631 cites W3174699664 @default.
- W4313019631 doi "https://doi.org/10.1109/cvpr52688.2022.01607" @default.
- W4313019631 hasPublicationYear "2022" @default.
- W4313019631 type Work @default.
- W4313019631 citedByCount "6" @default.
- W4313019631 countsByYear W43130196312022 @default.
- W4313019631 countsByYear W43130196312023 @default.
- W4313019631 crossrefType "proceedings-article" @default.
- W4313019631 hasAuthorship W4313019631A5016095713 @default.
- W4313019631 hasAuthorship W4313019631A5022792966 @default.
- W4313019631 hasAuthorship W4313019631A5058010200 @default.
- W4313019631 hasAuthorship W4313019631A5062293219 @default.
- W4313019631 hasAuthorship W4313019631A5084821923 @default.
- W4313019631 hasBestOaLocation W43130196312 @default.
- W4313019631 hasConcept C111368507 @default.
- W4313019631 hasConcept C111919701 @default.
- W4313019631 hasConcept C118505674 @default.
- W4313019631 hasConcept C119857082 @default.
- W4313019631 hasConcept C121332964 @default.
- W4313019631 hasConcept C121955636 @default.
- W4313019631 hasConcept C12725497 @default.
- W4313019631 hasConcept C127313418 @default.
- W4313019631 hasConcept C144133560 @default.
- W4313019631 hasConcept C154945302 @default.
- W4313019631 hasConcept C17744445 @default.
- W4313019631 hasConcept C196083921 @default.
- W4313019631 hasConcept C199539241 @default.
- W4313019631 hasConcept C2524010 @default.
- W4313019631 hasConcept C26517878 @default.
- W4313019631 hasConcept C2776359362 @default.
- W4313019631 hasConcept C2779886137 @default.
- W4313019631 hasConcept C33923547 @default.
- W4313019631 hasConcept C38652104 @default.
- W4313019631 hasConcept C38976095 @default.
- W4313019631 hasConcept C41008148 @default.
- W4313019631 hasConcept C59404180 @default.
- W4313019631 hasConcept C62520636 @default.
- W4313019631 hasConcept C80444323 @default.
- W4313019631 hasConcept C94625758 @default.
- W4313019631 hasConceptScore W4313019631C111368507 @default.
- W4313019631 hasConceptScore W4313019631C111919701 @default.
- W4313019631 hasConceptScore W4313019631C118505674 @default.
- W4313019631 hasConceptScore W4313019631C119857082 @default.
- W4313019631 hasConceptScore W4313019631C121332964 @default.
- W4313019631 hasConceptScore W4313019631C121955636 @default.
- W4313019631 hasConceptScore W4313019631C12725497 @default.
- W4313019631 hasConceptScore W4313019631C127313418 @default.
- W4313019631 hasConceptScore W4313019631C144133560 @default.
- W4313019631 hasConceptScore W4313019631C154945302 @default.
- W4313019631 hasConceptScore W4313019631C17744445 @default.
- W4313019631 hasConceptScore W4313019631C196083921 @default.
- W4313019631 hasConceptScore W4313019631C199539241 @default.
- W4313019631 hasConceptScore W4313019631C2524010 @default.
- W4313019631 hasConceptScore W4313019631C26517878 @default.
- W4313019631 hasConceptScore W4313019631C2776359362 @default.
- W4313019631 hasConceptScore W4313019631C2779886137 @default.
- W4313019631 hasConceptScore W4313019631C33923547 @default.
- W4313019631 hasConceptScore W4313019631C38652104 @default.
- W4313019631 hasConceptScore W4313019631C38976095 @default.
- W4313019631 hasConceptScore W4313019631C41008148 @default.
- W4313019631 hasConceptScore W4313019631C59404180 @default.
- W4313019631 hasConceptScore W4313019631C62520636 @default.
- W4313019631 hasConceptScore W4313019631C80444323 @default.
- W4313019631 hasConceptScore W4313019631C94625758 @default.
- W4313019631 hasLocation W43130196311 @default.
- W4313019631 hasLocation W43130196312 @default.
- W4313019631 hasOpenAccess W4313019631 @default.
- W4313019631 hasPrimaryLocation W43130196311 @default.
- W4313019631 hasRelatedWork W2236009071 @default.
- W4313019631 hasRelatedWork W3087493185 @default.
- W4313019631 hasRelatedWork W3139204794 @default.
- W4313019631 hasRelatedWork W3158586592 @default.
- W4313019631 hasRelatedWork W3173972271 @default.
- W4313019631 hasRelatedWork W4206762304 @default.
- W4313019631 hasRelatedWork W4221144353 @default.
- W4313019631 hasRelatedWork W4287270746 @default.
- W4313019631 hasRelatedWork W4298000443 @default.
- W4313019631 hasRelatedWork W4313019631 @default.
- W4313019631 isParatext "false" @default.
- W4313019631 isRetracted "false" @default.
- W4313019631 workType "article" @default.