Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287163514> ?p ?o ?g. }
Showing items 1 to 61 of
61
with 100 items per page.
- W4287163514 abstract "The hyper-parameters of a neural network are traditionally designed through a time consuming process of trial and error that requires substantial expert knowledge. Neural Architecture Search (NAS) algorithms aim to take the human out of the loop by automatically finding a good set of hyper-parameters for the problem at hand. These algorithms have mostly focused on hyper-parameters such as the architectural configurations of the hidden layers and the connectivity of the hidden neurons, but there has been relatively little work on automating the search for completely new activation functions, which are one of the most crucial hyper-parameters to choose. There are some widely used activation functions nowadays which are simple and work well, but nonetheless, there has been some interest in finding better activation functions. The work in the literature has mostly focused on designing new activation functions by hand, or choosing from a set of predefined functions while this work presents an evolutionary algorithm to automate the search for completely new activation functions. We compare these new evolved activation functions to other existing and commonly used activation functions. The results are favorable and are obtained from averaging the performance of the activation functions found over 30 runs, with experiments being conducted on 10 different datasets and architectures to ensure the statistical robustness of the study." @default.
- W4287163514 created "2022-07-25" @default.
- W4287163514 creator A5047508564 @default.
- W4287163514 creator A5089225436 @default.
- W4287163514 date "2021-05-30" @default.
- W4287163514 modified "2023-09-27" @default.
- W4287163514 title "Evolution of Activation Functions: An Empirical Investigation" @default.
- W4287163514 doi "https://doi.org/10.48550/arxiv.2105.14614" @default.
- W4287163514 hasPublicationYear "2021" @default.
- W4287163514 type Work @default.
- W4287163514 citedByCount "0" @default.
- W4287163514 crossrefType "posted-content" @default.
- W4287163514 hasAuthorship W4287163514A5047508564 @default.
- W4287163514 hasAuthorship W4287163514A5089225436 @default.
- W4287163514 hasBestOaLocation W42871635141 @default.
- W4287163514 hasConcept C104317684 @default.
- W4287163514 hasConcept C111919701 @default.
- W4287163514 hasConcept C119857082 @default.
- W4287163514 hasConcept C124101348 @default.
- W4287163514 hasConcept C154945302 @default.
- W4287163514 hasConcept C159149176 @default.
- W4287163514 hasConcept C177264268 @default.
- W4287163514 hasConcept C185592680 @default.
- W4287163514 hasConcept C199360897 @default.
- W4287163514 hasConcept C38365724 @default.
- W4287163514 hasConcept C41008148 @default.
- W4287163514 hasConcept C50644808 @default.
- W4287163514 hasConcept C55493867 @default.
- W4287163514 hasConcept C63479239 @default.
- W4287163514 hasConcept C98045186 @default.
- W4287163514 hasConceptScore W4287163514C104317684 @default.
- W4287163514 hasConceptScore W4287163514C111919701 @default.
- W4287163514 hasConceptScore W4287163514C119857082 @default.
- W4287163514 hasConceptScore W4287163514C124101348 @default.
- W4287163514 hasConceptScore W4287163514C154945302 @default.
- W4287163514 hasConceptScore W4287163514C159149176 @default.
- W4287163514 hasConceptScore W4287163514C177264268 @default.
- W4287163514 hasConceptScore W4287163514C185592680 @default.
- W4287163514 hasConceptScore W4287163514C199360897 @default.
- W4287163514 hasConceptScore W4287163514C38365724 @default.
- W4287163514 hasConceptScore W4287163514C41008148 @default.
- W4287163514 hasConceptScore W4287163514C50644808 @default.
- W4287163514 hasConceptScore W4287163514C55493867 @default.
- W4287163514 hasConceptScore W4287163514C63479239 @default.
- W4287163514 hasConceptScore W4287163514C98045186 @default.
- W4287163514 hasLocation W42871635141 @default.
- W4287163514 hasOpenAccess W4287163514 @default.
- W4287163514 hasPrimaryLocation W42871635141 @default.
- W4287163514 hasRelatedWork W1496157902 @default.
- W4287163514 hasRelatedWork W1525510058 @default.
- W4287163514 hasRelatedWork W2961085424 @default.
- W4287163514 hasRelatedWork W4223456145 @default.
- W4287163514 hasRelatedWork W4229568052 @default.
- W4287163514 hasRelatedWork W4235367588 @default.
- W4287163514 hasRelatedWork W4237634094 @default.
- W4287163514 hasRelatedWork W4247102092 @default.
- W4287163514 hasRelatedWork W4306674287 @default.
- W4287163514 hasRelatedWork W1629725936 @default.
- W4287163514 isParatext "false" @default.
- W4287163514 isRetracted "false" @default.
- W4287163514 workType "article" @default.