Matches in SemOpenAlex for { <https://semopenalex.org/work/W3088111503> ?p ?o ?g. }
Showing items 1 to 95 of
95
with 100 items per page.
- W3088111503 abstract "Activation functions play a pivotal role in the function learning using neural networks. The non-linearity in the learned function is achieved by repeated use of the activation function. Over the years, numerous activation functions have been proposed to improve accuracy in several tasks. Basic functions like ReLU, Sigmoid, Tanh, or Softplus have been favorite among the deep learning community because of their simplicity. In recent years, several novel activation functions arising from these basic functions have been proposed, which have improved accuracy in some challenging datasets. We propose a five hyper-parameters family of activation functions, namely EIS, defined as, [ frac{x(ln(1+e^x))^alpha}{sqrt{beta+gamma x^2}+delta e^{-theta x}}. ] We show examples of activation functions from the EIS family which outperform widely used activation functions on some well known datasets and models. For example, $frac{xln(1+e^x)}{x+1.16e^{-x}}$ beats ReLU by 0.89% in DenseNet-169, 0.24% in Inception V3 in CIFAR100 dataset while 1.13% in Inception V3, 0.13% in DenseNet-169, 0.94% in SimpleNet model in CIFAR10 dataset. Also, $frac{xln(1+e^x)}{sqrt{1+x^2}}$ beats ReLU by 1.68% in DenseNet-169, 0.30% in Inception V3 in CIFAR100 dataset while 1.0% in Inception V3, 0.15% in DenseNet-169, 1.13% in SimpleNet model in CIFAR10 dataset." @default.
- W3088111503 created "2020-10-01" @default.
- W3088111503 creator A5010852509 @default.
- W3088111503 creator A5022915831 @default.
- W3088111503 creator A5069200856 @default.
- W3088111503 creator A5090167516 @default.
- W3088111503 date "2020-09-28" @default.
- W3088111503 modified "2023-10-10" @default.
- W3088111503 title "EIS -- a family of activation functions combining Exponential, ISRU, and Softplus" @default.
- W3088111503 cites W1533861849 @default.
- W3088111503 cites W1572063013 @default.
- W3088111503 cites W1665214252 @default.
- W3088111503 cites W1667249920 @default.
- W3088111503 cites W1677182931 @default.
- W3088111503 cites W1921523184 @default.
- W3088111503 cites W2168148636 @default.
- W3088111503 cites W2176412452 @default.
- W3088111503 cites W2183341477 @default.
- W3088111503 cites W2335728318 @default.
- W3088111503 cites W2546302380 @default.
- W3088111503 cites W2610817424 @default.
- W3088111503 cites W2612445135 @default.
- W3088111503 cites W2616274621 @default.
- W3088111503 cites W2750384547 @default.
- W3088111503 cites W2766574708 @default.
- W3088111503 cites W2767286248 @default.
- W3088111503 cites W2769852551 @default.
- W3088111503 cites W2899663614 @default.
- W3088111503 cites W2899771611 @default.
- W3088111503 cites W2949117887 @default.
- W3088111503 cites W2951886768 @default.
- W3088111503 cites W2962834855 @default.
- W3088111503 cites W2963163009 @default.
- W3088111503 cites W2963446712 @default.
- W3088111503 cites W2964121744 @default.
- W3088111503 cites W3084225474 @default.
- W3088111503 cites W3118608800 @default.
- W3088111503 hasPublicationYear "2020" @default.
- W3088111503 type Work @default.
- W3088111503 sameAs 3088111503 @default.
- W3088111503 citedByCount "0" @default.
- W3088111503 crossrefType "posted-content" @default.
- W3088111503 hasAuthorship W3088111503A5010852509 @default.
- W3088111503 hasAuthorship W3088111503A5022915831 @default.
- W3088111503 hasAuthorship W3088111503A5069200856 @default.
- W3088111503 hasAuthorship W3088111503A5090167516 @default.
- W3088111503 hasConcept C11413529 @default.
- W3088111503 hasConcept C134306372 @default.
- W3088111503 hasConcept C14036430 @default.
- W3088111503 hasConcept C151376022 @default.
- W3088111503 hasConcept C154945302 @default.
- W3088111503 hasConcept C33923547 @default.
- W3088111503 hasConcept C38365724 @default.
- W3088111503 hasConcept C41008148 @default.
- W3088111503 hasConcept C50644808 @default.
- W3088111503 hasConcept C78458016 @default.
- W3088111503 hasConcept C81388566 @default.
- W3088111503 hasConcept C86803240 @default.
- W3088111503 hasConcept C92047909 @default.
- W3088111503 hasConceptScore W3088111503C11413529 @default.
- W3088111503 hasConceptScore W3088111503C134306372 @default.
- W3088111503 hasConceptScore W3088111503C14036430 @default.
- W3088111503 hasConceptScore W3088111503C151376022 @default.
- W3088111503 hasConceptScore W3088111503C154945302 @default.
- W3088111503 hasConceptScore W3088111503C33923547 @default.
- W3088111503 hasConceptScore W3088111503C38365724 @default.
- W3088111503 hasConceptScore W3088111503C41008148 @default.
- W3088111503 hasConceptScore W3088111503C50644808 @default.
- W3088111503 hasConceptScore W3088111503C78458016 @default.
- W3088111503 hasConceptScore W3088111503C81388566 @default.
- W3088111503 hasConceptScore W3088111503C86803240 @default.
- W3088111503 hasConceptScore W3088111503C92047909 @default.
- W3088111503 hasLocation W30881115031 @default.
- W3088111503 hasOpenAccess W3088111503 @default.
- W3088111503 hasPrimaryLocation W30881115031 @default.
- W3088111503 hasRelatedWork W142010742 @default.
- W3088111503 hasRelatedWork W1683511521 @default.
- W3088111503 hasRelatedWork W2122824685 @default.
- W3088111503 hasRelatedWork W2176103373 @default.
- W3088111503 hasRelatedWork W2803268044 @default.
- W3088111503 hasRelatedWork W2884522222 @default.
- W3088111503 hasRelatedWork W2902935192 @default.
- W3088111503 hasRelatedWork W2981298641 @default.
- W3088111503 hasRelatedWork W2994769837 @default.
- W3088111503 hasRelatedWork W3101333873 @default.
- W3088111503 hasRelatedWork W3109647083 @default.
- W3088111503 hasRelatedWork W3136579697 @default.
- W3088111503 hasRelatedWork W3137729713 @default.
- W3088111503 hasRelatedWork W3157893815 @default.
- W3088111503 hasRelatedWork W3173021457 @default.
- W3088111503 hasRelatedWork W3198895633 @default.
- W3088111503 isParatext "false" @default.
- W3088111503 isRetracted "false" @default.
- W3088111503 magId "3088111503" @default.
- W3088111503 workType "article" @default.