Matches in SemOpenAlex for { <https://semopenalex.org/work/W3215200098> ?p ?o ?g. }
Showing items 1 to 99 of
99
with 100 items per page.
- W3215200098 abstract "Self-supervised pretraining is the method of choice for natural language processing models and is rapidly gaining popularity in many vision tasks. Recently, self-supervised pretraining has shown to outperform supervised pretraining for many downstream vision applications, marking a milestone in the area. This superiority is attributed to the negative impact of incomplete labelling of the training images, which convey multiple concepts, but are annotated using a single dominant class label. Although Self-Supervised Learning (SSL), in principle, is free of this limitation, the choice of pretext task facilitating SSL is perpetuating this shortcoming by driving the learning process towards a single concept output. This study aims to investigate the possibility of modelling all the concepts present in an image without using labels. In this aspect the proposed SSL frame-work MC-SSL0.0 is a step towards Multi-Concept Self-Supervised Learning (MC-SSL) that goes beyond modelling single dominant label in an image to effectively utilise the information from all the concepts present in it. MC-SSL0.0 consists of two core design concepts, group masked model learning and learning of pseudo-concept for data token using a momentum encoder (teacher-student) framework. The experimental results on multi-label and multi-class image classification downstream tasks demonstrate that MC-SSL0.0 not only surpasses existing SSL methods but also outperforms supervised transfer learning. The source code will be made publicly available for community to train on bigger corpus." @default.
- W3215200098 created "2021-12-06" @default.
- W3215200098 creator A5025299678 @default.
- W3215200098 creator A5028209738 @default.
- W3215200098 creator A5037459105 @default.
- W3215200098 creator A5049721432 @default.
- W3215200098 creator A5087909247 @default.
- W3215200098 date "2021-11-30" @default.
- W3215200098 modified "2023-09-27" @default.
- W3215200098 title "MC-SSL0.0: Towards Multi-Concept Self-Supervised Learning" @default.
- W3215200098 cites W1821462560 @default.
- W3215200098 cites W1861492603 @default.
- W3215200098 cites W2037227137 @default.
- W3215200098 cites W2073459066 @default.
- W3215200098 cites W2138011018 @default.
- W3215200098 cites W2163605009 @default.
- W3215200098 cites W2277195237 @default.
- W3215200098 cites W2308529009 @default.
- W3215200098 cites W2321533354 @default.
- W3215200098 cites W2326925005 @default.
- W3215200098 cites W2411541852 @default.
- W3215200098 cites W2518108298 @default.
- W3215200098 cites W2533598788 @default.
- W3215200098 cites W2558661413 @default.
- W3215200098 cites W2562637781 @default.
- W3215200098 cites W2599837529 @default.
- W3215200098 cites W2765407302 @default.
- W3215200098 cites W2768282280 @default.
- W3215200098 cites W2798680770 @default.
- W3215200098 cites W2804047946 @default.
- W3215200098 cites W2883725317 @default.
- W3215200098 cites W2887997457 @default.
- W3215200098 cites W2895472239 @default.
- W3215200098 cites W2899663614 @default.
- W3215200098 cites W2948467580 @default.
- W3215200098 cites W2962742544 @default.
- W3215200098 cites W2963420272 @default.
- W3215200098 cites W2963495051 @default.
- W3215200098 cites W2963677766 @default.
- W3215200098 cites W2963826423 @default.
- W3215200098 cites W2970241862 @default.
- W3215200098 cites W2982112268 @default.
- W3215200098 cites W3034978746 @default.
- W3215200098 cites W3035060554 @default.
- W3215200098 cites W3035468615 @default.
- W3215200098 cites W3035524453 @default.
- W3215200098 cites W3035682985 @default.
- W3215200098 cites W3036224891 @default.
- W3215200098 cites W3036982689 @default.
- W3215200098 cites W3089555680 @default.
- W3215200098 cites W3094502228 @default.
- W3215200098 cites W3116489684 @default.
- W3215200098 cites W3118608800 @default.
- W3215200098 cites W3129576130 @default.
- W3215200098 cites W3143083666 @default.
- W3215200098 cites W3145450063 @default.
- W3215200098 cites W3170863103 @default.
- W3215200098 cites W3171007011 @default.
- W3215200098 cites W3171625335 @default.
- W3215200098 cites W3184087575 @default.
- W3215200098 cites W3195108980 @default.
- W3215200098 cites W3203444891 @default.
- W3215200098 cites W3211983881 @default.
- W3215200098 cites W343636949 @default.
- W3215200098 hasPublicationYear "2021" @default.
- W3215200098 type Work @default.
- W3215200098 sameAs 3215200098 @default.
- W3215200098 citedByCount "0" @default.
- W3215200098 crossrefType "posted-content" @default.
- W3215200098 hasAuthorship W3215200098A5025299678 @default.
- W3215200098 hasAuthorship W3215200098A5028209738 @default.
- W3215200098 hasAuthorship W3215200098A5037459105 @default.
- W3215200098 hasAuthorship W3215200098A5049721432 @default.
- W3215200098 hasAuthorship W3215200098A5087909247 @default.
- W3215200098 hasConcept C111919701 @default.
- W3215200098 hasConcept C119857082 @default.
- W3215200098 hasConcept C136389625 @default.
- W3215200098 hasConcept C153180895 @default.
- W3215200098 hasConcept C154945302 @default.
- W3215200098 hasConcept C2777212361 @default.
- W3215200098 hasConcept C41008148 @default.
- W3215200098 hasConcept C50644808 @default.
- W3215200098 hasConcept C98045186 @default.
- W3215200098 hasConceptScore W3215200098C111919701 @default.
- W3215200098 hasConceptScore W3215200098C119857082 @default.
- W3215200098 hasConceptScore W3215200098C136389625 @default.
- W3215200098 hasConceptScore W3215200098C153180895 @default.
- W3215200098 hasConceptScore W3215200098C154945302 @default.
- W3215200098 hasConceptScore W3215200098C2777212361 @default.
- W3215200098 hasConceptScore W3215200098C41008148 @default.
- W3215200098 hasConceptScore W3215200098C50644808 @default.
- W3215200098 hasConceptScore W3215200098C98045186 @default.
- W3215200098 hasLocation W32152000981 @default.
- W3215200098 hasOpenAccess W3215200098 @default.
- W3215200098 hasPrimaryLocation W32152000981 @default.
- W3215200098 isParatext "false" @default.
- W3215200098 isRetracted "false" @default.
- W3215200098 magId "3215200098" @default.
- W3215200098 workType "article" @default.