Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387596492> ?p ?o ?g. }
Showing items 1 to 69 of
69
with 100 items per page.
- W4387596492 abstract "Neural models based on hypercomplex algebra systems are growing and prolificating for a plethora of applications, ranging from computer vision to natural language processing. Hand in hand with their adoption, parameterized hypercomplex neural networks (PHNNs) are growing in size and no techniques have been adopted so far to control their convergence at a large scale. In this paper, we study PHNNs convergence and propose parameterized hypercomplex identity initialization (PHYDI), a method to improve their convergence at different scales, leading to more robust performance when the number of layers scales up, while also reaching the same performance with fewer iterations. We show the effectiveness of this approach in different benchmarks and with common PHNNs with ResNets- and Transformer-based architecture. The code is available at https://github.com/ispamm/PHYDI." @default.
- W4387596492 created "2023-10-13" @default.
- W4387596492 creator A5003606065 @default.
- W4387596492 creator A5019647783 @default.
- W4387596492 creator A5039283820 @default.
- W4387596492 creator A5093054954 @default.
- W4387596492 date "2023-10-11" @default.
- W4387596492 modified "2023-10-14" @default.
- W4387596492 title "PHYDI: Initializing Parameterized Hypercomplex Neural Networks as Identity Functions" @default.
- W4387596492 doi "https://doi.org/10.48550/arxiv.2310.07612" @default.
- W4387596492 hasPublicationYear "2023" @default.
- W4387596492 type Work @default.
- W4387596492 citedByCount "0" @default.
- W4387596492 crossrefType "posted-content" @default.
- W4387596492 hasAuthorship W4387596492A5003606065 @default.
- W4387596492 hasAuthorship W4387596492A5019647783 @default.
- W4387596492 hasAuthorship W4387596492A5039283820 @default.
- W4387596492 hasAuthorship W4387596492A5093054954 @default.
- W4387596492 hasBestOaLocation W43875964921 @default.
- W4387596492 hasConcept C11413529 @default.
- W4387596492 hasConcept C114466953 @default.
- W4387596492 hasConcept C154945302 @default.
- W4387596492 hasConcept C162324750 @default.
- W4387596492 hasConcept C165464430 @default.
- W4387596492 hasConcept C177264268 @default.
- W4387596492 hasConcept C199360897 @default.
- W4387596492 hasConcept C200127275 @default.
- W4387596492 hasConcept C203249530 @default.
- W4387596492 hasConcept C2524010 @default.
- W4387596492 hasConcept C2776760102 @default.
- W4387596492 hasConcept C2777303404 @default.
- W4387596492 hasConcept C33923547 @default.
- W4387596492 hasConcept C41008148 @default.
- W4387596492 hasConcept C50522688 @default.
- W4387596492 hasConcept C50644808 @default.
- W4387596492 hasConcept C80444323 @default.
- W4387596492 hasConceptScore W4387596492C11413529 @default.
- W4387596492 hasConceptScore W4387596492C114466953 @default.
- W4387596492 hasConceptScore W4387596492C154945302 @default.
- W4387596492 hasConceptScore W4387596492C162324750 @default.
- W4387596492 hasConceptScore W4387596492C165464430 @default.
- W4387596492 hasConceptScore W4387596492C177264268 @default.
- W4387596492 hasConceptScore W4387596492C199360897 @default.
- W4387596492 hasConceptScore W4387596492C200127275 @default.
- W4387596492 hasConceptScore W4387596492C203249530 @default.
- W4387596492 hasConceptScore W4387596492C2524010 @default.
- W4387596492 hasConceptScore W4387596492C2776760102 @default.
- W4387596492 hasConceptScore W4387596492C2777303404 @default.
- W4387596492 hasConceptScore W4387596492C33923547 @default.
- W4387596492 hasConceptScore W4387596492C41008148 @default.
- W4387596492 hasConceptScore W4387596492C50522688 @default.
- W4387596492 hasConceptScore W4387596492C50644808 @default.
- W4387596492 hasConceptScore W4387596492C80444323 @default.
- W4387596492 hasLocation W43875964921 @default.
- W4387596492 hasOpenAccess W4387596492 @default.
- W4387596492 hasPrimaryLocation W43875964921 @default.
- W4387596492 hasRelatedWork W2026218351 @default.
- W4387596492 hasRelatedWork W2044767466 @default.
- W4387596492 hasRelatedWork W2146426283 @default.
- W4387596492 hasRelatedWork W2800395957 @default.
- W4387596492 hasRelatedWork W2916518000 @default.
- W4387596492 hasRelatedWork W3082235301 @default.
- W4387596492 hasRelatedWork W3125691543 @default.
- W4387596492 hasRelatedWork W3185621658 @default.
- W4387596492 hasRelatedWork W4300216686 @default.
- W4387596492 hasRelatedWork W1578004053 @default.
- W4387596492 isParatext "false" @default.
- W4387596492 isRetracted "false" @default.
- W4387596492 workType "article" @default.