Matches in SemOpenAlex for { <https://semopenalex.org/work/W4382464396> ?p ?o ?g. }
Showing items 1 to 65 of
65
with 100 items per page.
- W4382464396 endingPage "10463" @default.
- W4382464396 startingPage "10453" @default.
- W4382464396 abstract "We formalize and analyze a fundamental component of dif- ferentiable neural architecture search (NAS): local “opera- tion scoring” at each operation choice. We view existing operation scoring functions as inexact proxies for accuracy, and we find that they perform poorly when analyzed empir- ically on NAS benchmarks. From this perspective, we intro- duce a novel perturbation-based zero-cost operation scor- ing (Zero-Cost-PT) approach, which utilizes zero-cost prox- ies that were recently studied in multi-trial NAS but de- grade significantly on larger search spaces, typical for dif- ferentiable NAS. We conduct a thorough empirical evalu- ation on a number of NAS benchmarks and large search spaces, from NAS-Bench-201, NAS-Bench-1Shot1, NAS- Bench-Macro, to DARTS-like and MobileNet-like spaces, showing significant improvements in both search time and accuracy. On the ImageNet classification task on the DARTS search space, our approach improved accuracy compared to the best current training-free methods (TE-NAS) while be- ing over 10× faster (total searching time 25 minutes on a single GPU), and observed significantly better transferabil- ity on architectures searched on the CIFAR-10 dataset with an accuracy increase of 1.8 pp. Our code is available at: https://github.com/zerocostptnas/zerocost operation score." @default.
- W4382464396 created "2023-06-29" @default.
- W4382464396 creator A5010814272 @default.
- W4382464396 creator A5022278971 @default.
- W4382464396 creator A5041828479 @default.
- W4382464396 creator A5045638679 @default.
- W4382464396 creator A5053684989 @default.
- W4382464396 creator A5080541362 @default.
- W4382464396 date "2023-06-26" @default.
- W4382464396 modified "2023-09-23" @default.
- W4382464396 title "Zero-Cost Operation Scoring in Differentiable Architecture Search" @default.
- W4382464396 doi "https://doi.org/10.1609/aaai.v37i9.26243" @default.
- W4382464396 hasPublicationYear "2023" @default.
- W4382464396 type Work @default.
- W4382464396 citedByCount "0" @default.
- W4382464396 crossrefType "journal-article" @default.
- W4382464396 hasAuthorship W4382464396A5010814272 @default.
- W4382464396 hasAuthorship W4382464396A5022278971 @default.
- W4382464396 hasAuthorship W4382464396A5041828479 @default.
- W4382464396 hasAuthorship W4382464396A5045638679 @default.
- W4382464396 hasAuthorship W4382464396A5053684989 @default.
- W4382464396 hasAuthorship W4382464396A5080541362 @default.
- W4382464396 hasBestOaLocation W43824643961 @default.
- W4382464396 hasConcept C119857082 @default.
- W4382464396 hasConcept C123657996 @default.
- W4382464396 hasConcept C134306372 @default.
- W4382464396 hasConcept C142362112 @default.
- W4382464396 hasConcept C153349607 @default.
- W4382464396 hasConcept C154945302 @default.
- W4382464396 hasConcept C166955791 @default.
- W4382464396 hasConcept C199360897 @default.
- W4382464396 hasConcept C202615002 @default.
- W4382464396 hasConcept C33923547 @default.
- W4382464396 hasConcept C41008148 @default.
- W4382464396 hasConceptScore W4382464396C119857082 @default.
- W4382464396 hasConceptScore W4382464396C123657996 @default.
- W4382464396 hasConceptScore W4382464396C134306372 @default.
- W4382464396 hasConceptScore W4382464396C142362112 @default.
- W4382464396 hasConceptScore W4382464396C153349607 @default.
- W4382464396 hasConceptScore W4382464396C154945302 @default.
- W4382464396 hasConceptScore W4382464396C166955791 @default.
- W4382464396 hasConceptScore W4382464396C199360897 @default.
- W4382464396 hasConceptScore W4382464396C202615002 @default.
- W4382464396 hasConceptScore W4382464396C33923547 @default.
- W4382464396 hasConceptScore W4382464396C41008148 @default.
- W4382464396 hasIssue "9" @default.
- W4382464396 hasLocation W43824643961 @default.
- W4382464396 hasOpenAccess W4382464396 @default.
- W4382464396 hasPrimaryLocation W43824643961 @default.
- W4382464396 hasRelatedWork W161568034 @default.
- W4382464396 hasRelatedWork W2364531466 @default.
- W4382464396 hasRelatedWork W2912956128 @default.
- W4382464396 hasRelatedWork W2961085424 @default.
- W4382464396 hasRelatedWork W3046775127 @default.
- W4382464396 hasRelatedWork W4285260836 @default.
- W4382464396 hasRelatedWork W4286629047 @default.
- W4382464396 hasRelatedWork W4306321456 @default.
- W4382464396 hasRelatedWork W4306674287 @default.
- W4382464396 hasRelatedWork W4224009465 @default.
- W4382464396 hasVolume "37" @default.
- W4382464396 isParatext "false" @default.
- W4382464396 isRetracted "false" @default.
- W4382464396 workType "article" @default.