FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3093929102> ?p ?o ?g. }

• W3093929102 abstract "Bootstrap Your Own Latent (BYOL) is a self-supervised learning approach for image representation. From an augmented view of an image, BYOL trains an online network to predict a target network representation of a different augmented view of the same image. Unlike contrastive methods, BYOL does not explicitly use a repulsion term built from negative pairs in its training objective. Yet, it avoids collapse to a trivial, constant representation. Thus, it has recently been hypothesized that batch normalization (BN) is critical to prevent collapse in BYOL. Indeed, BN flows gradients across batch elements, and could leak information about negative views in the batch, which could act as an implicit negative (contrastive) term. However, we experimentally show that replacing BN with a batch-independent normalization scheme (namely, a combination of group normalization and weight standardization) achieves performance comparable to vanilla BYOL ($73.9%$ vs. $74.3%$ top-1 accuracy under the linear evaluation protocol on ImageNet with ResNet-$50$). Our finding disproves the hypothesis that the use of batch statistics is a crucial ingredient for BYOL to learn useful representations." @default.
• W3093929102 created "2020-10-29" @default.
• W3093929102 creator A5002784136 @default.
• W3093929102 creator A5006805259 @default.
• W3093929102 creator A5008927786 @default.
• W3093929102 creator A5024394972 @default.
• W3093929102 creator A5036322364 @default.
• W3093929102 creator A5043910056 @default.
• W3093929102 creator A5051968502 @default.
• W3093929102 creator A5052176965 @default.
• W3093929102 creator A5066288640 @default.
• W3093929102 creator A5070500506 @default.
• W3093929102 creator A5091349569 @default.
• W3093929102 date "2020-10-20" @default.
• W3093929102 modified "2023-09-27" @default.
• W3093929102 title "BYOL works even without batch statistics." @default.
• W3093929102 cites W1836465849 @default.
• W3093929102 cites W2287334441 @default.
• W3093929102 cites W2326925005 @default.
• W3093929102 cites W2502312327 @default.
• W3093929102 cites W2592691248 @default.
• W3093929102 cites W2622263826 @default.
• W3093929102 cites W2749988060 @default.
• W3093929102 cites W2757910899 @default.
• W3093929102 cites W2842511635 @default.
• W3093929102 cites W2883725317 @default.
• W3093929102 cites W2946006146 @default.
• W3093929102 cites W2963037478 @default.
• W3093929102 cites W2963063862 @default.
• W3093929102 cites W2964065616 @default.
• W3093929102 cites W2964068654 @default.
• W3093929102 cites W2964275228 @default.
• W3093929102 cites W2971155163 @default.
• W3093929102 cites W3009561768 @default.
• W3093929102 cites W3034978746 @default.
• W3093929102 cites W3035058308 @default.
• W3093929102 cites W3035524453 @default.
• W3093929102 cites W3036982689 @default.
• W3093929102 cites W3041890730 @default.
• W3093929102 cites W3089824566 @default.
• W3093929102 cites W3095121901 @default.
• W3093929102 cites W3101821705 @default.
• W3093929102 hasPublicationYear "2020" @default.
• W3093929102 type Work @default.
• W3093929102 sameAs 3093929102 @default.
• W3093929102 citedByCount "17" @default.
• W3093929102 countsByYear W30939291022020 @default.
• W3093929102 countsByYear W30939291022021 @default.
• W3093929102 countsByYear W30939291022022 @default.
• W3093929102 crossrefType "posted-content" @default.
• W3093929102 hasAuthorship W3093929102A5002784136 @default.
• W3093929102 hasAuthorship W3093929102A5006805259 @default.
• W3093929102 hasAuthorship W3093929102A5008927786 @default.
• W3093929102 hasAuthorship W3093929102A5024394972 @default.
• W3093929102 hasAuthorship W3093929102A5036322364 @default.
• W3093929102 hasAuthorship W3093929102A5043910056 @default.
• W3093929102 hasAuthorship W3093929102A5051968502 @default.
• W3093929102 hasAuthorship W3093929102A5052176965 @default.
• W3093929102 hasAuthorship W3093929102A5066288640 @default.
• W3093929102 hasAuthorship W3093929102A5070500506 @default.
• W3093929102 hasAuthorship W3093929102A5091349569 @default.
• W3093929102 hasConcept C11413529 @default.
• W3093929102 hasConcept C115961682 @default.
• W3093929102 hasConcept C136886441 @default.
• W3093929102 hasConcept C144024400 @default.
• W3093929102 hasConcept C153180895 @default.
• W3093929102 hasConcept C154945302 @default.
• W3093929102 hasConcept C172658912 @default.
• W3093929102 hasConcept C17744445 @default.
• W3093929102 hasConcept C19165224 @default.
• W3093929102 hasConcept C199360897 @default.
• W3093929102 hasConcept C199539241 @default.
• W3093929102 hasConcept C2776359362 @default.
• W3093929102 hasConcept C33923547 @default.
• W3093929102 hasConcept C41008148 @default.
• W3093929102 hasConcept C51632099 @default.
• W3093929102 hasConcept C94625758 @default.
• W3093929102 hasConceptScore W3093929102C11413529 @default.
• W3093929102 hasConceptScore W3093929102C115961682 @default.
• W3093929102 hasConceptScore W3093929102C136886441 @default.
• W3093929102 hasConceptScore W3093929102C144024400 @default.
• W3093929102 hasConceptScore W3093929102C153180895 @default.
• W3093929102 hasConceptScore W3093929102C154945302 @default.
• W3093929102 hasConceptScore W3093929102C172658912 @default.
• W3093929102 hasConceptScore W3093929102C17744445 @default.
• W3093929102 hasConceptScore W3093929102C19165224 @default.
• W3093929102 hasConceptScore W3093929102C199360897 @default.
• W3093929102 hasConceptScore W3093929102C199539241 @default.
• W3093929102 hasConceptScore W3093929102C2776359362 @default.
• W3093929102 hasConceptScore W3093929102C33923547 @default.
• W3093929102 hasConceptScore W3093929102C41008148 @default.
• W3093929102 hasConceptScore W3093929102C51632099 @default.
• W3093929102 hasConceptScore W3093929102C94625758 @default.
• W3093929102 hasLocation W30939291021 @default.
• W3093929102 hasOpenAccess W3093929102 @default.
• W3093929102 hasPrimaryLocation W30939291021 @default.
• W3093929102 hasRelatedWork W1836465849 @default.
• W3093929102 hasRelatedWork W2108598243 @default.
• W3093929102 hasRelatedWork W2138621090 @default.
• W3093929102 hasRelatedWork W2194775991 @default.

• next