Matches in SemOpenAlex for { <https://semopenalex.org/work/W2125911849> ?p ?o ?g. }
- W2125911849 endingPage "843" @default.
- W2125911849 startingPage "813" @default.
- W2125911849 abstract "We explicitly analyze the trajectories of learning near singularities in hierarchical networks, such as multilayer perceptrons and radial basis function networks, which include permutation symmetry of hidden nodes, and show their general properties. Such symmetry induces singularities in their parameter space, where the Fisher information matrix degenerates and odd learning behaviors, especially the existence of plateaus in gradient descent learning, arise due to the geometric structure of singularity. We plot dynamic vector fields to demonstrate the universal trajectories of learning near singularities. The singularity induces two types of plateaus, the on-singularity plateau and the near-singularity plateau, depending on the stability of the singularity and the initial parameters of learning. The results presented in this letter are universally applicable to a wide class of hierarchical models. Detailed stability analysis of the dynamics of learning in radial basis function networks and multilayer perceptrons will be presented in separate work." @default.
- W2125911849 created "2016-06-24" @default.
- W2125911849 creator A5051266803 @default.
- W2125911849 creator A5055812530 @default.
- W2125911849 creator A5059571084 @default.
- W2125911849 creator A5061306478 @default.
- W2125911849 creator A5071672663 @default.
- W2125911849 date "2008-03-01" @default.
- W2125911849 modified "2023-10-16" @default.
- W2125911849 title "Dynamics of Learning Near Singularities in Layered Networks" @default.
- W2125911849 cites W1969891152 @default.
- W2125911849 cites W1970789124 @default.
- W2125911849 cites W1974755789 @default.
- W2125911849 cites W1981184437 @default.
- W2125911849 cites W1983918081 @default.
- W2125911849 cites W1987590702 @default.
- W2125911849 cites W1988190844 @default.
- W2125911849 cites W1988485873 @default.
- W2125911849 cites W1990359011 @default.
- W2125911849 cites W1995842804 @default.
- W2125911849 cites W1997504163 @default.
- W2125911849 cites W2006327398 @default.
- W2125911849 cites W2008430743 @default.
- W2125911849 cites W2010581677 @default.
- W2125911849 cites W2012644626 @default.
- W2125911849 cites W2020107577 @default.
- W2125911849 cites W2036487039 @default.
- W2125911849 cites W2037985840 @default.
- W2125911849 cites W2042318263 @default.
- W2125911849 cites W2043298855 @default.
- W2125911849 cites W2058563112 @default.
- W2125911849 cites W2059406974 @default.
- W2125911849 cites W2062351208 @default.
- W2125911849 cites W2086236873 @default.
- W2125911849 cites W2106413382 @default.
- W2125911849 cites W2110166586 @default.
- W2125911849 cites W2120217353 @default.
- W2125911849 cites W2127045326 @default.
- W2125911849 cites W2134101287 @default.
- W2125911849 cites W2139801605 @default.
- W2125911849 cites W3104693254 @default.
- W2125911849 cites W4248597109 @default.
- W2125911849 doi "https://doi.org/10.1162/neco.2007.12-06-414" @default.
- W2125911849 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/18045020" @default.
- W2125911849 hasPublicationYear "2008" @default.
- W2125911849 type Work @default.
- W2125911849 sameAs 2125911849 @default.
- W2125911849 citedByCount "60" @default.
- W2125911849 countsByYear W21259118492013 @default.
- W2125911849 countsByYear W21259118492014 @default.
- W2125911849 countsByYear W21259118492015 @default.
- W2125911849 countsByYear W21259118492016 @default.
- W2125911849 countsByYear W21259118492017 @default.
- W2125911849 countsByYear W21259118492018 @default.
- W2125911849 countsByYear W21259118492019 @default.
- W2125911849 countsByYear W21259118492020 @default.
- W2125911849 countsByYear W21259118492021 @default.
- W2125911849 countsByYear W21259118492022 @default.
- W2125911849 countsByYear W21259118492023 @default.
- W2125911849 crossrefType "journal-article" @default.
- W2125911849 hasAuthorship W2125911849A5051266803 @default.
- W2125911849 hasAuthorship W2125911849A5055812530 @default.
- W2125911849 hasAuthorship W2125911849A5059571084 @default.
- W2125911849 hasAuthorship W2125911849A5061306478 @default.
- W2125911849 hasAuthorship W2125911849A5071672663 @default.
- W2125911849 hasConcept C112972136 @default.
- W2125911849 hasConcept C119857082 @default.
- W2125911849 hasConcept C121332964 @default.
- W2125911849 hasConcept C121864883 @default.
- W2125911849 hasConcept C12843 @default.
- W2125911849 hasConcept C134306372 @default.
- W2125911849 hasConcept C154945302 @default.
- W2125911849 hasConcept C16171025 @default.
- W2125911849 hasConcept C207769094 @default.
- W2125911849 hasConcept C2524010 @default.
- W2125911849 hasConcept C2779886137 @default.
- W2125911849 hasConcept C33923547 @default.
- W2125911849 hasConcept C41008148 @default.
- W2125911849 hasConcept C50644808 @default.
- W2125911849 hasConcept C60908668 @default.
- W2125911849 hasConcept C71383303 @default.
- W2125911849 hasConceptScore W2125911849C112972136 @default.
- W2125911849 hasConceptScore W2125911849C119857082 @default.
- W2125911849 hasConceptScore W2125911849C121332964 @default.
- W2125911849 hasConceptScore W2125911849C121864883 @default.
- W2125911849 hasConceptScore W2125911849C12843 @default.
- W2125911849 hasConceptScore W2125911849C134306372 @default.
- W2125911849 hasConceptScore W2125911849C154945302 @default.
- W2125911849 hasConceptScore W2125911849C16171025 @default.
- W2125911849 hasConceptScore W2125911849C207769094 @default.
- W2125911849 hasConceptScore W2125911849C2524010 @default.
- W2125911849 hasConceptScore W2125911849C2779886137 @default.
- W2125911849 hasConceptScore W2125911849C33923547 @default.
- W2125911849 hasConceptScore W2125911849C41008148 @default.
- W2125911849 hasConceptScore W2125911849C50644808 @default.
- W2125911849 hasConceptScore W2125911849C60908668 @default.
- W2125911849 hasConceptScore W2125911849C71383303 @default.
- W2125911849 hasIssue "3" @default.