Matches in SemOpenAlex for { <https://semopenalex.org/work/W4312761303> ?p ?o ?g. }
Showing items 1 to 98 of
98
with 100 items per page.
- W4312761303 abstract "The paradigm of training models on massive data without label through self-supervised learning (SSL) and fine-tuning on many downstream tasks has become a trend recently. However, due to the high training costs and the un-consciousness of downstream usages, most self-supervised learning methods lack the capability to correspond to the diversities of downstream scenarios, as there are various data domains, different vision tasks and latency constraints on models. Neural architecture search (NAS) is one universally acknowledged fashion to conquer the issues above, but applying NAS on SSL seems impossible as there is no label or metric provided for judging model selection. In this paper, we present DATA, a simple yet effective NAS approach specialized for SSL that provides Domain-Aware and Task-Aware pre-training. Specifically, we (i) train a supernet which could be deemed as a set of millions of networks covering a wide range of model scales without any label, (ii) propose a flexible searching mechanism compatible with SSL that enables finding networks of different computation costs, for various downstream vision tasks and data domains without explicit metric provided. Instantiated With MoCo v2, our method achieves promising results across a wide range of computation costs on down-stream tasks, including image classification, object detection and semantic segmentation. DATA is orthogonal to most existing SSL methods and endows them the ability of customization on downstream needs. Extensive experiments on other SSL methods demonstrate the generalizability of the proposed method. Code is released at https://github.com/GAIA-vision/GAIA-ssl." @default.
- W4312761303 created "2023-01-05" @default.
- W4312761303 creator A5000494052 @default.
- W4312761303 creator A5028016065 @default.
- W4312761303 creator A5035983245 @default.
- W4312761303 creator A5041407824 @default.
- W4312761303 creator A5042383151 @default.
- W4312761303 creator A5064753974 @default.
- W4312761303 creator A5075290241 @default.
- W4312761303 date "2022-06-01" @default.
- W4312761303 modified "2023-10-07" @default.
- W4312761303 title "DATA: Domain-Aware and Task-Aware Self-supervised Learning" @default.
- W4312761303 cites W1903029394 @default.
- W4312761303 cites W2031489346 @default.
- W4312761303 cites W2078483536 @default.
- W4312761303 cites W2108598243 @default.
- W4312761303 cites W2194775991 @default.
- W4312761303 cites W2340897893 @default.
- W4312761303 cites W2565639579 @default.
- W4312761303 cites W2798991696 @default.
- W4312761303 cites W2960010704 @default.
- W4312761303 cites W2963150697 @default.
- W4312761303 cites W2964060161 @default.
- W4312761303 cites W2964081807 @default.
- W4312761303 cites W2964194231 @default.
- W4312761303 cites W2981698279 @default.
- W4312761303 cites W3035524453 @default.
- W4312761303 cites W3043547428 @default.
- W4312761303 cites W3095319910 @default.
- W4312761303 cites W3097607752 @default.
- W4312761303 cites W3109946440 @default.
- W4312761303 cites W3159481202 @default.
- W4312761303 cites W3168822201 @default.
- W4312761303 cites W3172615411 @default.
- W4312761303 cites W3174604157 @default.
- W4312761303 cites W3204801262 @default.
- W4312761303 cites W639708223 @default.
- W4312761303 doi "https://doi.org/10.1109/cvpr52688.2022.00961" @default.
- W4312761303 hasPublicationYear "2022" @default.
- W4312761303 type Work @default.
- W4312761303 citedByCount "2" @default.
- W4312761303 countsByYear W43127613032023 @default.
- W4312761303 crossrefType "proceedings-article" @default.
- W4312761303 hasAuthorship W4312761303A5000494052 @default.
- W4312761303 hasAuthorship W4312761303A5028016065 @default.
- W4312761303 hasAuthorship W4312761303A5035983245 @default.
- W4312761303 hasAuthorship W4312761303A5041407824 @default.
- W4312761303 hasAuthorship W4312761303A5042383151 @default.
- W4312761303 hasAuthorship W4312761303A5064753974 @default.
- W4312761303 hasAuthorship W4312761303A5075290241 @default.
- W4312761303 hasBestOaLocation W43127613032 @default.
- W4312761303 hasConcept C105795698 @default.
- W4312761303 hasConcept C119857082 @default.
- W4312761303 hasConcept C124101348 @default.
- W4312761303 hasConcept C154945302 @default.
- W4312761303 hasConcept C162324750 @default.
- W4312761303 hasConcept C176217482 @default.
- W4312761303 hasConcept C177264268 @default.
- W4312761303 hasConcept C187736073 @default.
- W4312761303 hasConcept C199360897 @default.
- W4312761303 hasConcept C21547014 @default.
- W4312761303 hasConcept C27158222 @default.
- W4312761303 hasConcept C2776207758 @default.
- W4312761303 hasConcept C2780451532 @default.
- W4312761303 hasConcept C33923547 @default.
- W4312761303 hasConcept C41008148 @default.
- W4312761303 hasConceptScore W4312761303C105795698 @default.
- W4312761303 hasConceptScore W4312761303C119857082 @default.
- W4312761303 hasConceptScore W4312761303C124101348 @default.
- W4312761303 hasConceptScore W4312761303C154945302 @default.
- W4312761303 hasConceptScore W4312761303C162324750 @default.
- W4312761303 hasConceptScore W4312761303C176217482 @default.
- W4312761303 hasConceptScore W4312761303C177264268 @default.
- W4312761303 hasConceptScore W4312761303C187736073 @default.
- W4312761303 hasConceptScore W4312761303C199360897 @default.
- W4312761303 hasConceptScore W4312761303C21547014 @default.
- W4312761303 hasConceptScore W4312761303C27158222 @default.
- W4312761303 hasConceptScore W4312761303C2776207758 @default.
- W4312761303 hasConceptScore W4312761303C2780451532 @default.
- W4312761303 hasConceptScore W4312761303C33923547 @default.
- W4312761303 hasConceptScore W4312761303C41008148 @default.
- W4312761303 hasLocation W43127613031 @default.
- W4312761303 hasLocation W43127613032 @default.
- W4312761303 hasOpenAccess W4312761303 @default.
- W4312761303 hasPrimaryLocation W43127613031 @default.
- W4312761303 hasRelatedWork W2084164722 @default.
- W4312761303 hasRelatedWork W2951915053 @default.
- W4312761303 hasRelatedWork W2961085424 @default.
- W4312761303 hasRelatedWork W4200511449 @default.
- W4312761303 hasRelatedWork W4285260836 @default.
- W4312761303 hasRelatedWork W4286629047 @default.
- W4312761303 hasRelatedWork W4306321456 @default.
- W4312761303 hasRelatedWork W4306674287 @default.
- W4312761303 hasRelatedWork W4386228649 @default.
- W4312761303 hasRelatedWork W4224009465 @default.
- W4312761303 isParatext "false" @default.
- W4312761303 isRetracted "false" @default.
- W4312761303 workType "article" @default.