FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3204659849> ?p ?o ?g. }

• W3204659849 abstract "In the image domain, excellent representations can be learned by inducing invariance to content-preserving transformations via noise contrastive learning. In this paper, we generalize contrastive learning to a wider set of transformations, and their compositions, for which either invariance or distinctiveness is sought. We show that it is not immediately obvious how existing methods such as SimCLR can be extended to do so. Instead, we introduce a number of formal requirements that all contrastive formulations must satisfy, and propose a practical construction which satisfies these requirements. In order to maximise the reach of this analysis, we express all components of noise contrastive formulations as the choice of certain generalized transformations of the data (GDTs), including data sampling. We then consider videos as an example of data in which a large variety of transformations are applicable, accounting for the extra modalities – for which we analyze audio and text – and the dimension of time. We find that being invariant to certain transformations and distinctive to others is critical to learning effective video representations, improving the state-of-the-art for multiple benchmarks by a large margin, and even surpassing supervised pretraining. Code and pretrained models are available <sup xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink>1</sup> ." @default.
• W3204659849 created "2021-10-11" @default.
• W3204659849 creator A5018721572 @default.
• W3204659849 creator A5030205315 @default.
• W3204659849 creator A5044477785 @default.
• W3204659849 creator A5057806352 @default.
• W3204659849 creator A5060511349 @default.
• W3204659849 creator A5069954850 @default.
• W3204659849 creator A5084478386 @default.
• W3204659849 date "2021-10-01" @default.
• W3204659849 modified "2023-09-30" @default.
• W3204659849 title "On Compositions of Transformations in Contrastive Self-Supervised Learning" @default.
• W3204659849 cites W2114996241 @default.
• W3204659849 cites W2126579184 @default.
• W3204659849 cites W2138621090 @default.
• W3204659849 cites W2194775991 @default.
• W3204659849 cites W2550462002 @default.
• W3204659849 cites W2558661413 @default.
• W3204659849 cites W2619697695 @default.
• W3204659849 cites W2750549109 @default.
• W3204659849 cites W2798991696 @default.
• W3204659849 cites W2799087757 @default.
• W3204659849 cites W2936774411 @default.
• W3204659849 cites W2948242301 @default.
• W3204659849 cites W2963155035 @default.
• W3204659849 cites W2963420272 @default.
• W3204659849 cites W2963814513 @default.
• W3204659849 cites W2964037671 @default.
• W3204659849 cites W2980037812 @default.
• W3204659849 cites W2981851019 @default.
• W3204659849 cites W2981851635 @default.
• W3204659849 cites W2984008963 @default.
• W3204659849 cites W2984818716 @default.
• W3204659849 cites W2987741655 @default.
• W3204659849 cites W3010874390 @default.
• W3204659849 cites W3018265077 @default.
• W3204659849 cites W3034215340 @default.
• W3204659849 cites W3034556939 @default.
• W3204659849 cites W3034630387 @default.
• W3204659849 cites W3034781633 @default.
• W3204659849 cites W3035118106 @default.
• W3204659849 cites W3035524453 @default.
• W3204659849 cites W3035635319 @default.
• W3204659849 cites W3046614818 @default.
• W3204659849 cites W3108655343 @default.
• W3204659849 cites W343636949 @default.
• W3204659849 doi "https://doi.org/10.1109/iccv48922.2021.00944" @default.
• W3204659849 hasPublicationYear "2021" @default.
• W3204659849 type Work @default.
• W3204659849 sameAs 3204659849 @default.
• W3204659849 citedByCount "14" @default.
• W3204659849 countsByYear W32046598492021 @default.
• W3204659849 countsByYear W32046598492022 @default.
• W3204659849 countsByYear W32046598492023 @default.
• W3204659849 crossrefType "proceedings-article" @default.
• W3204659849 hasAuthorship W3204659849A5018721572 @default.
• W3204659849 hasAuthorship W3204659849A5030205315 @default.
• W3204659849 hasAuthorship W3204659849A5044477785 @default.
• W3204659849 hasAuthorship W3204659849A5057806352 @default.
• W3204659849 hasAuthorship W3204659849A5060511349 @default.
• W3204659849 hasAuthorship W3204659849A5069954850 @default.
• W3204659849 hasAuthorship W3204659849A5084478386 @default.
• W3204659849 hasBestOaLocation W32046598492 @default.
• W3204659849 hasConcept C115961682 @default.
• W3204659849 hasConcept C119857082 @default.
• W3204659849 hasConcept C154945302 @default.
• W3204659849 hasConcept C15744967 @default.
• W3204659849 hasConcept C177264268 @default.
• W3204659849 hasConcept C190470478 @default.
• W3204659849 hasConcept C199360897 @default.
• W3204659849 hasConcept C204321447 @default.
• W3204659849 hasConcept C33923547 @default.
• W3204659849 hasConcept C37914503 @default.
• W3204659849 hasConcept C41008148 @default.
• W3204659849 hasConcept C47385372 @default.
• W3204659849 hasConcept C542102704 @default.
• W3204659849 hasConcept C774472 @default.
• W3204659849 hasConcept C80444323 @default.
• W3204659849 hasConcept C99498987 @default.
• W3204659849 hasConceptScore W3204659849C115961682 @default.
• W3204659849 hasConceptScore W3204659849C119857082 @default.
• W3204659849 hasConceptScore W3204659849C154945302 @default.
• W3204659849 hasConceptScore W3204659849C15744967 @default.
• W3204659849 hasConceptScore W3204659849C177264268 @default.
• W3204659849 hasConceptScore W3204659849C190470478 @default.
• W3204659849 hasConceptScore W3204659849C199360897 @default.
• W3204659849 hasConceptScore W3204659849C204321447 @default.
• W3204659849 hasConceptScore W3204659849C33923547 @default.
• W3204659849 hasConceptScore W3204659849C37914503 @default.
• W3204659849 hasConceptScore W3204659849C41008148 @default.
• W3204659849 hasConceptScore W3204659849C47385372 @default.
• W3204659849 hasConceptScore W3204659849C542102704 @default.
• W3204659849 hasConceptScore W3204659849C774472 @default.
• W3204659849 hasConceptScore W3204659849C80444323 @default.
• W3204659849 hasConceptScore W3204659849C99498987 @default.
• W3204659849 hasLocation W32046598491 @default.
• W3204659849 hasLocation W32046598492 @default.
• W3204659849 hasLocation W32046598493 @default.
• W3204659849 hasOpenAccess W3204659849 @default.
• W3204659849 hasPrimaryLocation W32046598491 @default.

• next