Matches in SemOpenAlex for { <https://semopenalex.org/work/W2023695846> ?p ?o ?g. }
Showing items 1 to 80 of
80
with 100 items per page.
- W2023695846 endingPage "4437" @default.
- W2023695846 startingPage "4425" @default.
- W2023695846 abstract "We study on-line learning with a momentum term for nonlinear learning rules. Through introduction of auxiliary variables, we show that the learning process can be described by a Markov process. For small learning parameters eta and momentum parameters alpha close to 1, such that gamma = eta /(1- alpha )2 is finite, the time-scales for the evolution of the weights and the auxiliary variables are the same. In this case Van Kampen's expansion can be applied in a straightforward manner. We obtain evolution equations for the average network state and the fluctuations around this average. These evolution equations depend (after rescaling a of the time and fluctuations) only on gamma : all combinations ( eta , alpha ) with the same value of gamma give rise to similar behaviour. The case with alpha constant and eta small requires a completely different analysis. There are two different time-scales: a fast time-scale on which the auxiliary variables equilibrate and a slow time-scale for the change of the weights. By projection on the space of slow variables the fast variables can be eliminated. We find that, for small learning parameters eta and finite momentum parameters alpha , learning with momentum is equivalent to learning without a momentum term with a rescaled learning parameter eta = eta /(1- alpha ). Simulations with the nonlinear Oja learning rule confirm the theoretical results." @default.
- W2023695846 created "2016-06-24" @default.
- W2023695846 creator A5006597762 @default.
- W2023695846 creator A5015444349 @default.
- W2023695846 creator A5074628150 @default.
- W2023695846 date "1994-07-07" @default.
- W2023695846 modified "2023-09-26" @default.
- W2023695846 title "Stochastic dynamics of learning with momentum in neural networks" @default.
- W2023695846 cites W1990359011 @default.
- W2023695846 cites W2003005926 @default.
- W2023695846 cites W2018033898 @default.
- W2023695846 cites W2019796162 @default.
- W2023695846 cites W2057902083 @default.
- W2023695846 cites W2086420260 @default.
- W2023695846 cites W2432567885 @default.
- W2023695846 doi "https://doi.org/10.1088/0305-4470/27/13/017" @default.
- W2023695846 hasPublicationYear "1994" @default.
- W2023695846 type Work @default.
- W2023695846 sameAs 2023695846 @default.
- W2023695846 citedByCount "30" @default.
- W2023695846 countsByYear W20236958462012 @default.
- W2023695846 countsByYear W20236958462013 @default.
- W2023695846 countsByYear W20236958462015 @default.
- W2023695846 countsByYear W20236958462016 @default.
- W2023695846 countsByYear W20236958462017 @default.
- W2023695846 countsByYear W20236958462018 @default.
- W2023695846 countsByYear W20236958462019 @default.
- W2023695846 countsByYear W20236958462020 @default.
- W2023695846 countsByYear W20236958462021 @default.
- W2023695846 crossrefType "journal-article" @default.
- W2023695846 hasAuthorship W2023695846A5006597762 @default.
- W2023695846 hasAuthorship W2023695846A5015444349 @default.
- W2023695846 hasAuthorship W2023695846A5074628150 @default.
- W2023695846 hasBestOaLocation W20236958462 @default.
- W2023695846 hasConcept C106159729 @default.
- W2023695846 hasConcept C121332964 @default.
- W2023695846 hasConcept C121864883 @default.
- W2023695846 hasConcept C145912823 @default.
- W2023695846 hasConcept C154945302 @default.
- W2023695846 hasConcept C15744967 @default.
- W2023695846 hasConcept C162324750 @default.
- W2023695846 hasConcept C19417346 @default.
- W2023695846 hasConcept C2984125019 @default.
- W2023695846 hasConcept C41008148 @default.
- W2023695846 hasConcept C50644808 @default.
- W2023695846 hasConcept C60718061 @default.
- W2023695846 hasConceptScore W2023695846C106159729 @default.
- W2023695846 hasConceptScore W2023695846C121332964 @default.
- W2023695846 hasConceptScore W2023695846C121864883 @default.
- W2023695846 hasConceptScore W2023695846C145912823 @default.
- W2023695846 hasConceptScore W2023695846C154945302 @default.
- W2023695846 hasConceptScore W2023695846C15744967 @default.
- W2023695846 hasConceptScore W2023695846C162324750 @default.
- W2023695846 hasConceptScore W2023695846C19417346 @default.
- W2023695846 hasConceptScore W2023695846C2984125019 @default.
- W2023695846 hasConceptScore W2023695846C41008148 @default.
- W2023695846 hasConceptScore W2023695846C50644808 @default.
- W2023695846 hasConceptScore W2023695846C60718061 @default.
- W2023695846 hasIssue "13" @default.
- W2023695846 hasLocation W20236958461 @default.
- W2023695846 hasLocation W20236958462 @default.
- W2023695846 hasOpenAccess W2023695846 @default.
- W2023695846 hasPrimaryLocation W20236958461 @default.
- W2023695846 hasRelatedWork W1964110685 @default.
- W2023695846 hasRelatedWork W1984587408 @default.
- W2023695846 hasRelatedWork W1994600733 @default.
- W2023695846 hasRelatedWork W1998392933 @default.
- W2023695846 hasRelatedWork W2023695846 @default.
- W2023695846 hasRelatedWork W2922175597 @default.
- W2023695846 hasRelatedWork W3006164462 @default.
- W2023695846 hasRelatedWork W3129483202 @default.
- W2023695846 hasRelatedWork W33244840 @default.
- W2023695846 hasRelatedWork W70782505 @default.
- W2023695846 hasVolume "27" @default.
- W2023695846 isParatext "false" @default.
- W2023695846 isRetracted "false" @default.
- W2023695846 magId "2023695846" @default.
- W2023695846 workType "article" @default.