Matches in SemOpenAlex for { <https://semopenalex.org/work/W2059406974> ?p ?o ?g. }
Showing items 1 to 74 of
74
with 100 items per page.
- W2059406974 endingPage "11764" @default.
- W2059406974 startingPage "11753" @default.
- W2059406974 abstract "In the over-realizable learning scenario of multilayer perceptrons, in which the student network has a larger number of hidden units than the true or optimal network, some of the weight parameters are unidentifiable. In this case, the teacher network consists of a union of optimal subspaces included in the parameter space. The optimal subspaces, which lead to singularities, are known to affect the estimation performance of neural networks. Using statistical mechanics, we investigate the online learning dynamics of two-layer neural networks in the over-realizable scenario with unidentifiable parameters. We show that the convergence speed strongly depends on the initial parameter conditions. We also show that there is a quasi-plateau around the optimal subspace, which differs from the well-known plateaus caused by permutation symmetry. In addition, we discuss the property of the final learning state, relating this to the singular structures." @default.
- W2059406974 created "2016-06-24" @default.
- W2059406974 creator A5019279003 @default.
- W2059406974 creator A5066486693 @default.
- W2059406974 creator A5087193833 @default.
- W2059406974 date "2003-11-11" @default.
- W2059406974 modified "2023-10-18" @default.
- W2059406974 title "Online learning dynamics of multilayer perceptrons with unidentifiable parameters" @default.
- W2059406974 cites W1969891152 @default.
- W2059406974 cites W1974755789 @default.
- W2059406974 cites W1976010944 @default.
- W2059406974 cites W1995842804 @default.
- W2059406974 cites W2005099280 @default.
- W2059406974 cites W2037985840 @default.
- W2059406974 cites W2086236873 @default.
- W2059406974 cites W2110166586 @default.
- W2059406974 cites W2120217353 @default.
- W2059406974 cites W3104693254 @default.
- W2059406974 doi "https://doi.org/10.1088/0305-4470/36/47/004" @default.
- W2059406974 hasPublicationYear "2003" @default.
- W2059406974 type Work @default.
- W2059406974 sameAs 2059406974 @default.
- W2059406974 citedByCount "20" @default.
- W2059406974 countsByYear W20594069742014 @default.
- W2059406974 countsByYear W20594069742015 @default.
- W2059406974 countsByYear W20594069742017 @default.
- W2059406974 countsByYear W20594069742018 @default.
- W2059406974 countsByYear W20594069742019 @default.
- W2059406974 countsByYear W20594069742020 @default.
- W2059406974 countsByYear W20594069742022 @default.
- W2059406974 countsByYear W20594069742023 @default.
- W2059406974 crossrefType "journal-article" @default.
- W2059406974 hasAuthorship W2059406974A5019279003 @default.
- W2059406974 hasAuthorship W2059406974A5066486693 @default.
- W2059406974 hasAuthorship W2059406974A5087193833 @default.
- W2059406974 hasConcept C136764020 @default.
- W2059406974 hasConcept C145912823 @default.
- W2059406974 hasConcept C154945302 @default.
- W2059406974 hasConcept C15744967 @default.
- W2059406974 hasConcept C19417346 @default.
- W2059406974 hasConcept C2986087404 @default.
- W2059406974 hasConcept C41008148 @default.
- W2059406974 hasConcept C50644808 @default.
- W2059406974 hasConcept C60908668 @default.
- W2059406974 hasConceptScore W2059406974C136764020 @default.
- W2059406974 hasConceptScore W2059406974C145912823 @default.
- W2059406974 hasConceptScore W2059406974C154945302 @default.
- W2059406974 hasConceptScore W2059406974C15744967 @default.
- W2059406974 hasConceptScore W2059406974C19417346 @default.
- W2059406974 hasConceptScore W2059406974C2986087404 @default.
- W2059406974 hasConceptScore W2059406974C41008148 @default.
- W2059406974 hasConceptScore W2059406974C50644808 @default.
- W2059406974 hasConceptScore W2059406974C60908668 @default.
- W2059406974 hasIssue "47" @default.
- W2059406974 hasLocation W20594069741 @default.
- W2059406974 hasOpenAccess W2059406974 @default.
- W2059406974 hasPrimaryLocation W20594069741 @default.
- W2059406974 hasRelatedWork W1501213224 @default.
- W2059406974 hasRelatedWork W1585811901 @default.
- W2059406974 hasRelatedWork W1985582580 @default.
- W2059406974 hasRelatedWork W2059406974 @default.
- W2059406974 hasRelatedWork W2097293837 @default.
- W2059406974 hasRelatedWork W2550787675 @default.
- W2059406974 hasRelatedWork W2783038087 @default.
- W2059406974 hasRelatedWork W3106494386 @default.
- W2059406974 hasRelatedWork W3183987844 @default.
- W2059406974 hasRelatedWork W1515410566 @default.
- W2059406974 hasVolume "36" @default.
- W2059406974 isParatext "false" @default.
- W2059406974 isRetracted "false" @default.
- W2059406974 magId "2059406974" @default.
- W2059406974 workType "article" @default.