Matches in SemOpenAlex for { <https://semopenalex.org/work/W4310263254> ?p ?o ?g. }
Showing items 1 to 97 of
97
with 100 items per page.
- W4310263254 abstract "One-shot neural architecture search (NAS) substantially improves the search efficiency by training one supernet to estimate the performance of every possible child architecture (i.e., subnet). However, the inconsistency of characteristics among subnets incurs serious interference in the optimization, resulting in poor performance ranking correlation of subnets. Subsequent explorations decompose supernet weights via a particular criterion, e.g., gradient matching, to reduce the interference; yet they suffer from huge computational cost and low space separability. In this work, we propose a lightweight and effective local intrinsic dimension (LID)-based method NAS-LID. NAS-LID evaluates the geometrical properties of architectures by calculating the low-cost LID features layer-by-layer, and the similarity characterized by LID enjoys better separability compared with gradients, which thus effectively reduces the interference among subnets. Extensive experiments on NASBench-201 indicate that NAS-LID achieves superior performance with better efficiency. Specifically, compared to the gradient-driven method, NAS-LID can save up to 86% of GPU memory overhead when searching on NASBench-201. We also demonstrate the effectiveness of NAS-LID on ProxylessNAS and OFA spaces. Source code: https://github.com/marsggbo/NAS-LID." @default.
- W4310263254 created "2022-11-30" @default.
- W4310263254 creator A5013663383 @default.
- W4310263254 creator A5034417471 @default.
- W4310263254 creator A5048313055 @default.
- W4310263254 creator A5061700759 @default.
- W4310263254 creator A5064192009 @default.
- W4310263254 creator A5067500703 @default.
- W4310263254 creator A5077539496 @default.
- W4310263254 creator A5089325282 @default.
- W4310263254 date "2022-11-23" @default.
- W4310263254 modified "2023-10-16" @default.
- W4310263254 title "NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension" @default.
- W4310263254 doi "https://doi.org/10.48550/arxiv.2211.12759" @default.
- W4310263254 hasPublicationYear "2022" @default.
- W4310263254 type Work @default.
- W4310263254 citedByCount "0" @default.
- W4310263254 crossrefType "posted-content" @default.
- W4310263254 hasAuthorship W4310263254A5013663383 @default.
- W4310263254 hasAuthorship W4310263254A5034417471 @default.
- W4310263254 hasAuthorship W4310263254A5048313055 @default.
- W4310263254 hasAuthorship W4310263254A5061700759 @default.
- W4310263254 hasAuthorship W4310263254A5064192009 @default.
- W4310263254 hasAuthorship W4310263254A5067500703 @default.
- W4310263254 hasAuthorship W4310263254A5077539496 @default.
- W4310263254 hasAuthorship W4310263254A5089325282 @default.
- W4310263254 hasBestOaLocation W43102632541 @default.
- W4310263254 hasConcept C103278499 @default.
- W4310263254 hasConcept C105795698 @default.
- W4310263254 hasConcept C111919701 @default.
- W4310263254 hasConcept C113775141 @default.
- W4310263254 hasConcept C11413529 @default.
- W4310263254 hasConcept C115961682 @default.
- W4310263254 hasConcept C123657996 @default.
- W4310263254 hasConcept C127162648 @default.
- W4310263254 hasConcept C142362112 @default.
- W4310263254 hasConcept C153349607 @default.
- W4310263254 hasConcept C154945302 @default.
- W4310263254 hasConcept C165064840 @default.
- W4310263254 hasConcept C177264268 @default.
- W4310263254 hasConcept C178790620 @default.
- W4310263254 hasConcept C185592680 @default.
- W4310263254 hasConcept C199360897 @default.
- W4310263254 hasConcept C202444582 @default.
- W4310263254 hasConcept C21099817 @default.
- W4310263254 hasConcept C2776760102 @default.
- W4310263254 hasConcept C2779227376 @default.
- W4310263254 hasConcept C2779960059 @default.
- W4310263254 hasConcept C31258907 @default.
- W4310263254 hasConcept C32022120 @default.
- W4310263254 hasConcept C33676613 @default.
- W4310263254 hasConcept C33923547 @default.
- W4310263254 hasConcept C41008148 @default.
- W4310263254 hasConcept C50644808 @default.
- W4310263254 hasConceptScore W4310263254C103278499 @default.
- W4310263254 hasConceptScore W4310263254C105795698 @default.
- W4310263254 hasConceptScore W4310263254C111919701 @default.
- W4310263254 hasConceptScore W4310263254C113775141 @default.
- W4310263254 hasConceptScore W4310263254C11413529 @default.
- W4310263254 hasConceptScore W4310263254C115961682 @default.
- W4310263254 hasConceptScore W4310263254C123657996 @default.
- W4310263254 hasConceptScore W4310263254C127162648 @default.
- W4310263254 hasConceptScore W4310263254C142362112 @default.
- W4310263254 hasConceptScore W4310263254C153349607 @default.
- W4310263254 hasConceptScore W4310263254C154945302 @default.
- W4310263254 hasConceptScore W4310263254C165064840 @default.
- W4310263254 hasConceptScore W4310263254C177264268 @default.
- W4310263254 hasConceptScore W4310263254C178790620 @default.
- W4310263254 hasConceptScore W4310263254C185592680 @default.
- W4310263254 hasConceptScore W4310263254C199360897 @default.
- W4310263254 hasConceptScore W4310263254C202444582 @default.
- W4310263254 hasConceptScore W4310263254C21099817 @default.
- W4310263254 hasConceptScore W4310263254C2776760102 @default.
- W4310263254 hasConceptScore W4310263254C2779227376 @default.
- W4310263254 hasConceptScore W4310263254C2779960059 @default.
- W4310263254 hasConceptScore W4310263254C31258907 @default.
- W4310263254 hasConceptScore W4310263254C32022120 @default.
- W4310263254 hasConceptScore W4310263254C33676613 @default.
- W4310263254 hasConceptScore W4310263254C33923547 @default.
- W4310263254 hasConceptScore W4310263254C41008148 @default.
- W4310263254 hasConceptScore W4310263254C50644808 @default.
- W4310263254 hasLocation W43102632541 @default.
- W4310263254 hasOpenAccess W4310263254 @default.
- W4310263254 hasPrimaryLocation W43102632541 @default.
- W4310263254 hasRelatedWork W1510166563 @default.
- W4310263254 hasRelatedWork W2028024605 @default.
- W4310263254 hasRelatedWork W2114473615 @default.
- W4310263254 hasRelatedWork W2309211897 @default.
- W4310263254 hasRelatedWork W2370690322 @default.
- W4310263254 hasRelatedWork W2373724792 @default.
- W4310263254 hasRelatedWork W2386387936 @default.
- W4310263254 hasRelatedWork W2390043387 @default.
- W4310263254 hasRelatedWork W2767525681 @default.
- W4310263254 hasRelatedWork W2950203496 @default.
- W4310263254 isParatext "false" @default.
- W4310263254 isRetracted "false" @default.
- W4310263254 workType "article" @default.