Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287179426> ?p ?o ?g. }
Showing items 1 to 59 of
59
with 100 items per page.
- W4287179426 abstract "We propose a new type of neural networks, Kronecker neural networks (KNNs), that form a general framework for neural networks with adaptive activation functions. KNNs employ the Kronecker product, which provides an efficient way of constructing a very wide network while keeping the number of parameters low. Our theoretical analysis reveals that under suitable conditions, KNNs induce a faster decay of the loss than that by the feed-forward networks. This is also empirically verified through a set of computational examples. Furthermore, under certain technical assumptions, we establish global convergence of gradient descent for KNNs. As a specific case, we propose the Rowdy activation function that is designed to get rid of any saturation region by injecting sinusoidal fluctuations, which include trainable parameters. The proposed Rowdy activation function can be employed in any neural network architecture like feed-forward neural networks, Recurrent neural networks, Convolutional neural networks etc. The effectiveness of KNNs with Rowdy activation is demonstrated through various computational experiments including function approximation using feed-forward neural networks, solution inference of partial differential equations using the physics-informed neural networks, and standard deep learning benchmark problems using convolutional and fully-connected neural networks." @default.
- W4287179426 created "2022-07-25" @default.
- W4287179426 creator A5003184366 @default.
- W4287179426 creator A5005886655 @default.
- W4287179426 creator A5023632213 @default.
- W4287179426 creator A5061905151 @default.
- W4287179426 date "2021-05-20" @default.
- W4287179426 modified "2023-09-26" @default.
- W4287179426 title "Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functions" @default.
- W4287179426 doi "https://doi.org/10.48550/arxiv.2105.09513" @default.
- W4287179426 hasPublicationYear "2021" @default.
- W4287179426 type Work @default.
- W4287179426 citedByCount "0" @default.
- W4287179426 crossrefType "posted-content" @default.
- W4287179426 hasAuthorship W4287179426A5003184366 @default.
- W4287179426 hasAuthorship W4287179426A5005886655 @default.
- W4287179426 hasAuthorship W4287179426A5023632213 @default.
- W4287179426 hasAuthorship W4287179426A5061905151 @default.
- W4287179426 hasBestOaLocation W42871794261 @default.
- W4287179426 hasConcept C108583219 @default.
- W4287179426 hasConcept C14036430 @default.
- W4287179426 hasConcept C147168706 @default.
- W4287179426 hasConcept C153258448 @default.
- W4287179426 hasConcept C154945302 @default.
- W4287179426 hasConcept C177973122 @default.
- W4287179426 hasConcept C38365724 @default.
- W4287179426 hasConcept C41008148 @default.
- W4287179426 hasConcept C50644808 @default.
- W4287179426 hasConcept C78458016 @default.
- W4287179426 hasConcept C81363708 @default.
- W4287179426 hasConcept C86803240 @default.
- W4287179426 hasConceptScore W4287179426C108583219 @default.
- W4287179426 hasConceptScore W4287179426C14036430 @default.
- W4287179426 hasConceptScore W4287179426C147168706 @default.
- W4287179426 hasConceptScore W4287179426C153258448 @default.
- W4287179426 hasConceptScore W4287179426C154945302 @default.
- W4287179426 hasConceptScore W4287179426C177973122 @default.
- W4287179426 hasConceptScore W4287179426C38365724 @default.
- W4287179426 hasConceptScore W4287179426C41008148 @default.
- W4287179426 hasConceptScore W4287179426C50644808 @default.
- W4287179426 hasConceptScore W4287179426C78458016 @default.
- W4287179426 hasConceptScore W4287179426C81363708 @default.
- W4287179426 hasConceptScore W4287179426C86803240 @default.
- W4287179426 hasLocation W42871794261 @default.
- W4287179426 hasOpenAccess W4287179426 @default.
- W4287179426 hasPrimaryLocation W42871794261 @default.
- W4287179426 hasRelatedWork W2137516498 @default.
- W4287179426 hasRelatedWork W2480330148 @default.
- W4287179426 hasRelatedWork W2952741290 @default.
- W4287179426 hasRelatedWork W2998088892 @default.
- W4287179426 hasRelatedWork W3005641657 @default.
- W4287179426 hasRelatedWork W3088445005 @default.
- W4287179426 hasRelatedWork W3129882263 @default.
- W4287179426 hasRelatedWork W3133500041 @default.
- W4287179426 hasRelatedWork W3176779650 @default.
- W4287179426 hasRelatedWork W1988248940 @default.
- W4287179426 isParatext "false" @default.
- W4287179426 isRetracted "false" @default.
- W4287179426 workType "article" @default.