Matches in SemOpenAlex for { <https://semopenalex.org/work/W4320342458> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W4320342458 abstract "In recent years, zero-cost proxies are gaining ground in neural architecture search (NAS). These methods allow finding the optimal neural network for a given task faster and with a lesser computational load than conventional NAS methods. Equally important is the fact that they also shed some light on the internal workings of neural architectures. This paper presents a zero-cost metric that highly correlates with the train set accuracy across the NAS-Bench-101, NAS-Bench-201 and NAS-Bench-NLP benchmark datasets. Architectures are initialised with two distinct constant shared weights, one at a time. Then, a fixed random mini-batch of data is passed forward through each initialisation. We observe that the dispersion of the outputs between two initialisations positively correlates with trained accuracy. The correlation further improves when we normalise dispersion by average output magnitude. Our metric, epsilon, does not require gradients computation or labels. It thus unbinds the NAS procedure from training hyperparameters, loss metrics and human-labelled data. Our method is easy to integrate within existing NAS algorithms and takes a fraction of a second to evaluate a single network." @default.
- W4320342458 created "2023-02-13" @default.
- W4320342458 creator A5058495458 @default.
- W4320342458 date "2023-02-08" @default.
- W4320342458 modified "2023-09-23" @default.
- W4320342458 title "Light and Accurate: Neural Architecture Search via Two Constant Shared Weights Initialisations" @default.
- W4320342458 doi "https://doi.org/10.48550/arxiv.2302.04406" @default.
- W4320342458 hasPublicationYear "2023" @default.
- W4320342458 type Work @default.
- W4320342458 citedByCount "0" @default.
- W4320342458 crossrefType "posted-content" @default.
- W4320342458 hasAuthorship W4320342458A5058495458 @default.
- W4320342458 hasBestOaLocation W43203424581 @default.
- W4320342458 hasConcept C11413529 @default.
- W4320342458 hasConcept C119857082 @default.
- W4320342458 hasConcept C127413603 @default.
- W4320342458 hasConcept C13280743 @default.
- W4320342458 hasConcept C149629883 @default.
- W4320342458 hasConcept C154945302 @default.
- W4320342458 hasConcept C176217482 @default.
- W4320342458 hasConcept C177264268 @default.
- W4320342458 hasConcept C178790620 @default.
- W4320342458 hasConcept C185592680 @default.
- W4320342458 hasConcept C185798385 @default.
- W4320342458 hasConcept C193415008 @default.
- W4320342458 hasConcept C199360897 @default.
- W4320342458 hasConcept C205649164 @default.
- W4320342458 hasConcept C21547014 @default.
- W4320342458 hasConcept C2777027219 @default.
- W4320342458 hasConcept C38652104 @default.
- W4320342458 hasConcept C41008148 @default.
- W4320342458 hasConcept C45374587 @default.
- W4320342458 hasConcept C50644808 @default.
- W4320342458 hasConcept C8642999 @default.
- W4320342458 hasConceptScore W4320342458C11413529 @default.
- W4320342458 hasConceptScore W4320342458C119857082 @default.
- W4320342458 hasConceptScore W4320342458C127413603 @default.
- W4320342458 hasConceptScore W4320342458C13280743 @default.
- W4320342458 hasConceptScore W4320342458C149629883 @default.
- W4320342458 hasConceptScore W4320342458C154945302 @default.
- W4320342458 hasConceptScore W4320342458C176217482 @default.
- W4320342458 hasConceptScore W4320342458C177264268 @default.
- W4320342458 hasConceptScore W4320342458C178790620 @default.
- W4320342458 hasConceptScore W4320342458C185592680 @default.
- W4320342458 hasConceptScore W4320342458C185798385 @default.
- W4320342458 hasConceptScore W4320342458C193415008 @default.
- W4320342458 hasConceptScore W4320342458C199360897 @default.
- W4320342458 hasConceptScore W4320342458C205649164 @default.
- W4320342458 hasConceptScore W4320342458C21547014 @default.
- W4320342458 hasConceptScore W4320342458C2777027219 @default.
- W4320342458 hasConceptScore W4320342458C38652104 @default.
- W4320342458 hasConceptScore W4320342458C41008148 @default.
- W4320342458 hasConceptScore W4320342458C45374587 @default.
- W4320342458 hasConceptScore W4320342458C50644808 @default.
- W4320342458 hasConceptScore W4320342458C8642999 @default.
- W4320342458 hasLocation W43203424581 @default.
- W4320342458 hasOpenAccess W4320342458 @default.
- W4320342458 hasPrimaryLocation W43203424581 @default.
- W4320342458 hasRelatedWork W2966858528 @default.
- W4320342458 hasRelatedWork W3081580854 @default.
- W4320342458 hasRelatedWork W3199608561 @default.
- W4320342458 hasRelatedWork W4205222687 @default.
- W4320342458 hasRelatedWork W4210794429 @default.
- W4320342458 hasRelatedWork W4223456145 @default.
- W4320342458 hasRelatedWork W4280535922 @default.
- W4320342458 hasRelatedWork W4287683259 @default.
- W4320342458 hasRelatedWork W4295309597 @default.
- W4320342458 hasRelatedWork W4309113015 @default.
- W4320342458 isParatext "false" @default.
- W4320342458 isRetracted "false" @default.
- W4320342458 workType "article" @default.