FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386065536> ?p ?o ?g. }

• W4386065536 abstract "With the wide and deep adoption of deep learning models in real applications, there is an increasing need to model and learn the representations of the neural networks themselves. These models can be used to estimate attributes of different neural network architectures such as the accuracy and latency, without running the actual training or inference tasks. In this paper, we propose a neural architecture representation model that can be used to estimate these attributes holistically. Specifically, we first propose a simple and effective tokenizer to encode both the operation and topology information of a neural network into a single sequence. Then, we design a multi-stage fusion transformer to build a compact vector representation from the converted sequence. For efficient model training, we further propose an information flow consistency augmentation and correspondingly design an architecture consistency loss, which brings more benefits with less augmentation samples compared with previous random augmentation strategies. Experiment results on NAS-Bench-101, NAS-Bench-201, DARTS search space and NNLQP show that our proposed framework can be used to predict the aforementioned latency and accuracy attributes of both cell architectures and whole deep neural networks, and achieves promising performance. Code is available at https://github.com/yuny220/NAR-Former." @default.
• W4386065536 created "2023-08-23" @default.
• W4386065536 creator A5000092852 @default.
• W4386065536 creator A5015720040 @default.
• W4386065536 creator A5018764462 @default.
• W4386065536 creator A5024792434 @default.
• W4386065536 creator A5086045569 @default.
• W4386065536 date "2023-06-01" @default.
• W4386065536 modified "2023-09-23" @default.
• W4386065536 title "NAR-Former: Neural Architecture Representation Learning Towards Holistic Attributes Prediction" @default.
• W4386065536 cites W2018764772 @default.
• W4386065536 cites W2108598243 @default.
• W4386065536 cites W2194775991 @default.
• W4386065536 cites W2963446712 @default.
• W4386065536 cites W2965658867 @default.
• W4386065536 cites W2981406437 @default.
• W4386065536 cites W2997806280 @default.
• W4386065536 cites W3013310686 @default.
• W4386065536 cites W3107453328 @default.
• W4386065536 cites W3138516171 @default.
• W4386065536 cites W3165698711 @default.
• W4386065536 cites W3173166478 @default.
• W4386065536 cites W3176772026 @default.
• W4386065536 cites W3185010627 @default.
• W4386065536 cites W3203760080 @default.
• W4386065536 cites W4200150166 @default.
• W4386065536 cites W4283809036 @default.
• W4386065536 cites W4320067919 @default.
• W4386065536 doi "https://doi.org/10.1109/cvpr52729.2023.00745" @default.
• W4386065536 hasPublicationYear "2023" @default.
• W4386065536 type Work @default.
• W4386065536 citedByCount "0" @default.
• W4386065536 crossrefType "proceedings-article" @default.
• W4386065536 hasAuthorship W4386065536A5000092852 @default.
• W4386065536 hasAuthorship W4386065536A5015720040 @default.
• W4386065536 hasAuthorship W4386065536A5018764462 @default.
• W4386065536 hasAuthorship W4386065536A5024792434 @default.
• W4386065536 hasAuthorship W4386065536A5086045569 @default.
• W4386065536 hasConcept C104317684 @default.
• W4386065536 hasConcept C108583219 @default.
• W4386065536 hasConcept C119857082 @default.
• W4386065536 hasConcept C123657996 @default.
• W4386065536 hasConcept C142362112 @default.
• W4386065536 hasConcept C153349607 @default.
• W4386065536 hasConcept C154945302 @default.
• W4386065536 hasConcept C177264268 @default.
• W4386065536 hasConcept C17744445 @default.
• W4386065536 hasConcept C185592680 @default.
• W4386065536 hasConcept C199360897 @default.
• W4386065536 hasConcept C199539241 @default.
• W4386065536 hasConcept C2776214188 @default.
• W4386065536 hasConcept C2776359362 @default.
• W4386065536 hasConcept C2776436953 @default.
• W4386065536 hasConcept C2776760102 @default.
• W4386065536 hasConcept C41008148 @default.
• W4386065536 hasConcept C50644808 @default.
• W4386065536 hasConcept C55493867 @default.
• W4386065536 hasConcept C59404180 @default.
• W4386065536 hasConcept C66746571 @default.
• W4386065536 hasConcept C76155785 @default.
• W4386065536 hasConcept C82876162 @default.
• W4386065536 hasConcept C94625758 @default.
• W4386065536 hasConceptScore W4386065536C104317684 @default.
• W4386065536 hasConceptScore W4386065536C108583219 @default.
• W4386065536 hasConceptScore W4386065536C119857082 @default.
• W4386065536 hasConceptScore W4386065536C123657996 @default.
• W4386065536 hasConceptScore W4386065536C142362112 @default.
• W4386065536 hasConceptScore W4386065536C153349607 @default.
• W4386065536 hasConceptScore W4386065536C154945302 @default.
• W4386065536 hasConceptScore W4386065536C177264268 @default.
• W4386065536 hasConceptScore W4386065536C17744445 @default.
• W4386065536 hasConceptScore W4386065536C185592680 @default.
• W4386065536 hasConceptScore W4386065536C199360897 @default.
• W4386065536 hasConceptScore W4386065536C199539241 @default.
• W4386065536 hasConceptScore W4386065536C2776214188 @default.
• W4386065536 hasConceptScore W4386065536C2776359362 @default.
• W4386065536 hasConceptScore W4386065536C2776436953 @default.
• W4386065536 hasConceptScore W4386065536C2776760102 @default.
• W4386065536 hasConceptScore W4386065536C41008148 @default.
• W4386065536 hasConceptScore W4386065536C50644808 @default.
• W4386065536 hasConceptScore W4386065536C55493867 @default.
• W4386065536 hasConceptScore W4386065536C59404180 @default.
• W4386065536 hasConceptScore W4386065536C66746571 @default.
• W4386065536 hasConceptScore W4386065536C76155785 @default.
• W4386065536 hasConceptScore W4386065536C82876162 @default.
• W4386065536 hasConceptScore W4386065536C94625758 @default.
• W4386065536 hasFunder F4320321001 @default.
• W4386065536 hasFunder F4320327831 @default.
• W4386065536 hasFunder F4320335777 @default.
• W4386065536 hasLocation W43860655361 @default.
• W4386065536 hasOpenAccess W4386065536 @default.
• W4386065536 hasPrimaryLocation W43860655361 @default.
• W4386065536 hasRelatedWork W3014300295 @default.
• W4386065536 hasRelatedWork W3164822677 @default.
• W4386065536 hasRelatedWork W4223943233 @default.
• W4386065536 hasRelatedWork W4225161397 @default.
• W4386065536 hasRelatedWork W4250304930 @default.
• W4386065536 hasRelatedWork W4312200629 @default.
• W4386065536 hasRelatedWork W4360585206 @default.
• W4386065536 hasRelatedWork W4364306694 @default.

• next