Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386721631> ?p ?o ?g. }
Showing items 1 to 73 of
73
with 100 items per page.
- W4386721631 abstract "We prove the converse of the universal approximation theorem, i.e. a neural network (NN) encoding theorem which shows that for every stably converged NN of continuous activation functions, its weight matrix actually encodes a continuous function that approximates its training dataset to within a finite margin of error over a bounded domain. We further show that using the Eckart-Young theorem for truncated singular value decomposition of the weight matrix for every NN layer, we can illuminate the nature of the latent space manifold of the training dataset encoded and represented by every NN layer, and the geometric nature of the mathematical operations performed by each NN layer. Our results have implications for understanding how NNs break the curse of dimensionality by harnessing memory capacity for expressivity, and that the two are complementary. This Layer Matrix Decomposition (LMD) further suggests a close relationship between eigen-decomposition of NN layers and the latest advances in conceptualizations of Hopfield networks and Transformer NN models." @default.
- W4386721631 created "2023-09-14" @default.
- W4386721631 creator A5006467926 @default.
- W4386721631 creator A5048821705 @default.
- W4386721631 creator A5049934766 @default.
- W4386721631 date "2023-09-12" @default.
- W4386721631 modified "2023-09-30" @default.
- W4386721631 title "Neural Network Layer Matrix Decomposition reveals Latent Manifold Encoding and Memory Capacity" @default.
- W4386721631 doi "https://doi.org/10.48550/arxiv.2309.05968" @default.
- W4386721631 hasPublicationYear "2023" @default.
- W4386721631 type Work @default.
- W4386721631 citedByCount "0" @default.
- W4386721631 crossrefType "posted-content" @default.
- W4386721631 hasAuthorship W4386721631A5006467926 @default.
- W4386721631 hasAuthorship W4386721631A5048821705 @default.
- W4386721631 hasAuthorship W4386721631A5049934766 @default.
- W4386721631 hasBestOaLocation W43867216311 @default.
- W4386721631 hasConcept C106487976 @default.
- W4386721631 hasConcept C111030470 @default.
- W4386721631 hasConcept C11413529 @default.
- W4386721631 hasConcept C114614502 @default.
- W4386721631 hasConcept C118615104 @default.
- W4386721631 hasConcept C125411270 @default.
- W4386721631 hasConcept C127413603 @default.
- W4386721631 hasConcept C134306372 @default.
- W4386721631 hasConcept C154945302 @default.
- W4386721631 hasConcept C159985019 @default.
- W4386721631 hasConcept C184720557 @default.
- W4386721631 hasConcept C192562407 @default.
- W4386721631 hasConcept C202444582 @default.
- W4386721631 hasConcept C22789450 @default.
- W4386721631 hasConcept C33923547 @default.
- W4386721631 hasConcept C34388435 @default.
- W4386721631 hasConcept C41008148 @default.
- W4386721631 hasConcept C50644808 @default.
- W4386721631 hasConcept C529865628 @default.
- W4386721631 hasConcept C78519656 @default.
- W4386721631 hasConceptScore W4386721631C106487976 @default.
- W4386721631 hasConceptScore W4386721631C111030470 @default.
- W4386721631 hasConceptScore W4386721631C11413529 @default.
- W4386721631 hasConceptScore W4386721631C114614502 @default.
- W4386721631 hasConceptScore W4386721631C118615104 @default.
- W4386721631 hasConceptScore W4386721631C125411270 @default.
- W4386721631 hasConceptScore W4386721631C127413603 @default.
- W4386721631 hasConceptScore W4386721631C134306372 @default.
- W4386721631 hasConceptScore W4386721631C154945302 @default.
- W4386721631 hasConceptScore W4386721631C159985019 @default.
- W4386721631 hasConceptScore W4386721631C184720557 @default.
- W4386721631 hasConceptScore W4386721631C192562407 @default.
- W4386721631 hasConceptScore W4386721631C202444582 @default.
- W4386721631 hasConceptScore W4386721631C22789450 @default.
- W4386721631 hasConceptScore W4386721631C33923547 @default.
- W4386721631 hasConceptScore W4386721631C34388435 @default.
- W4386721631 hasConceptScore W4386721631C41008148 @default.
- W4386721631 hasConceptScore W4386721631C50644808 @default.
- W4386721631 hasConceptScore W4386721631C529865628 @default.
- W4386721631 hasConceptScore W4386721631C78519656 @default.
- W4386721631 hasLocation W43867216311 @default.
- W4386721631 hasOpenAccess W4386721631 @default.
- W4386721631 hasPrimaryLocation W43867216311 @default.
- W4386721631 hasRelatedWork W1598979804 @default.
- W4386721631 hasRelatedWork W1972801555 @default.
- W4386721631 hasRelatedWork W1991469418 @default.
- W4386721631 hasRelatedWork W2018828049 @default.
- W4386721631 hasRelatedWork W2042726902 @default.
- W4386721631 hasRelatedWork W2067846690 @default.
- W4386721631 hasRelatedWork W2136053165 @default.
- W4386721631 hasRelatedWork W2389073067 @default.
- W4386721631 hasRelatedWork W3102909640 @default.
- W4386721631 hasRelatedWork W4313283835 @default.
- W4386721631 isParatext "false" @default.
- W4386721631 isRetracted "false" @default.
- W4386721631 workType "article" @default.