Matches in SemOpenAlex for { <https://semopenalex.org/work/W4320855529> ?p ?o ?g. }
Showing items 1 to 58 of
58
with 100 items per page.
- W4320855529 abstract "Self-supervised learning (SSL) methods aim to exploit the abundance of unlabelled data for machine learning (ML), however the underlying principles are often method-specific. An SSL framework derived from biological first principles of embodied learning could unify the various SSL methods, help elucidate learning in the brain, and possibly improve ML. SSL commonly transforms each training datapoint into a pair of views, uses the knowledge of this pairing as a positive (i.e. non-contrastive) self-supervisory sign, and potentially opposes it to unrelated, (i.e. contrastive) negative examples. Here, we show that this type of self-supervision is an incomplete implementation of a concept from neuroscience, the Efference Copy (EC). Specifically, the brain also transforms the environment through efference, i.e. motor commands, however it sends to itself an EC of the full commands, i.e. more than a mere SSL sign. In addition, its action representations are likely egocentric. From such a principled foundation we formally recover and extend SSL methods such as SimCLR, BYOL, and ReLIC under a common theoretical framework, i.e. Self-supervision Through Efference Copies (S-TEC). Empirically, S-TEC restructures meaningfully the within- and between-class representations. This manifests as improvement in recent strong SSL baselines in image classification, segmentation, object detection, and in audio. These results hypothesize a testable positive influence from the brain's motor outputs onto its sensory representations." @default.
- W4320855529 created "2023-02-16" @default.
- W4320855529 creator A5015433561 @default.
- W4320855529 creator A5060417441 @default.
- W4320855529 creator A5068706250 @default.
- W4320855529 date "2022-10-17" @default.
- W4320855529 modified "2023-09-28" @default.
- W4320855529 title "Self-Supervised Learning Through Efference Copies" @default.
- W4320855529 doi "https://doi.org/10.48550/arxiv.2210.09224" @default.
- W4320855529 hasPublicationYear "2022" @default.
- W4320855529 type Work @default.
- W4320855529 citedByCount "0" @default.
- W4320855529 crossrefType "posted-content" @default.
- W4320855529 hasAuthorship W4320855529A5015433561 @default.
- W4320855529 hasAuthorship W4320855529A5060417441 @default.
- W4320855529 hasAuthorship W4320855529A5068706250 @default.
- W4320855529 hasBestOaLocation W43208555291 @default.
- W4320855529 hasConcept C107690735 @default.
- W4320855529 hasConcept C119857082 @default.
- W4320855529 hasConcept C134306372 @default.
- W4320855529 hasConcept C139676723 @default.
- W4320855529 hasConcept C153050134 @default.
- W4320855529 hasConcept C154945302 @default.
- W4320855529 hasConcept C15744967 @default.
- W4320855529 hasConcept C169760540 @default.
- W4320855529 hasConcept C2778942571 @default.
- W4320855529 hasConcept C2781238097 @default.
- W4320855529 hasConcept C33923547 @default.
- W4320855529 hasConcept C41008148 @default.
- W4320855529 hasConceptScore W4320855529C107690735 @default.
- W4320855529 hasConceptScore W4320855529C119857082 @default.
- W4320855529 hasConceptScore W4320855529C134306372 @default.
- W4320855529 hasConceptScore W4320855529C139676723 @default.
- W4320855529 hasConceptScore W4320855529C153050134 @default.
- W4320855529 hasConceptScore W4320855529C154945302 @default.
- W4320855529 hasConceptScore W4320855529C15744967 @default.
- W4320855529 hasConceptScore W4320855529C169760540 @default.
- W4320855529 hasConceptScore W4320855529C2778942571 @default.
- W4320855529 hasConceptScore W4320855529C2781238097 @default.
- W4320855529 hasConceptScore W4320855529C33923547 @default.
- W4320855529 hasConceptScore W4320855529C41008148 @default.
- W4320855529 hasLocation W43208555291 @default.
- W4320855529 hasLocation W43208555292 @default.
- W4320855529 hasOpenAccess W4320855529 @default.
- W4320855529 hasPrimaryLocation W43208555291 @default.
- W4320855529 hasRelatedWork W2961085424 @default.
- W4320855529 hasRelatedWork W3046775127 @default.
- W4320855529 hasRelatedWork W3170094116 @default.
- W4320855529 hasRelatedWork W3209574120 @default.
- W4320855529 hasRelatedWork W4205958290 @default.
- W4320855529 hasRelatedWork W4285260836 @default.
- W4320855529 hasRelatedWork W4286629047 @default.
- W4320855529 hasRelatedWork W4306321456 @default.
- W4320855529 hasRelatedWork W4306674287 @default.
- W4320855529 hasRelatedWork W4224009465 @default.
- W4320855529 isParatext "false" @default.
- W4320855529 isRetracted "false" @default.
- W4320855529 workType "article" @default.