Matches in SemOpenAlex for { <https://semopenalex.org/work/W2906128209> ?p ?o ?g. }
Showing items 1 to 88 of
88
with 100 items per page.
- W2906128209 abstract "We study two types of preconditioners and preconditioned stochastic gradient descent (SGD) methods in a unified framework. We call the first one the Newton type due to its close relationship to the Newton method, and the second one the Fisher type as its preconditioner is closely related to the inverse of Fisher information matrix. Both preconditioners can be derived from one framework, and efficiently estimated on any matrix Lie groups designated by the user using natural or relative gradient descent minimizing certain preconditioner estimation criteria. Many existing preconditioners and methods, e.g., RMSProp, Adam, KFAC, equilibrated SGD, batch normalization, etc., are special cases of or closely related to either the Newton type or the Fisher type ones. Experimental results on relatively large scale machine learning problems are reported for performance study." @default.
- W2906128209 created "2019-01-01" @default.
- W2906128209 creator A5019779405 @default.
- W2906128209 date "2018-09-26" @default.
- W2906128209 modified "2023-09-23" @default.
- W2906128209 title "Preconditioner on Matrix Lie Group for SGD." @default.
- W2906128209 cites W1498436455 @default.
- W2906128209 cites W1522301498 @default.
- W2906128209 cites W2146502635 @default.
- W2906128209 cites W2155894447 @default.
- W2906128209 cites W2217490359 @default.
- W2906128209 cites W2296319761 @default.
- W2906128209 cites W2951037516 @default.
- W2906128209 hasPublicationYear "2018" @default.
- W2906128209 type Work @default.
- W2906128209 sameAs 2906128209 @default.
- W2906128209 citedByCount "0" @default.
- W2906128209 crossrefType "posted-content" @default.
- W2906128209 hasAuthorship W2906128209A5019779405 @default.
- W2906128209 hasConcept C106487976 @default.
- W2906128209 hasConcept C11413529 @default.
- W2906128209 hasConcept C121332964 @default.
- W2906128209 hasConcept C136886441 @default.
- W2906128209 hasConcept C144024400 @default.
- W2906128209 hasConcept C154945302 @default.
- W2906128209 hasConcept C159694833 @default.
- W2906128209 hasConcept C167431342 @default.
- W2906128209 hasConcept C185592680 @default.
- W2906128209 hasConcept C19165224 @default.
- W2906128209 hasConcept C206688291 @default.
- W2906128209 hasConcept C207467116 @default.
- W2906128209 hasConcept C2524010 @default.
- W2906128209 hasConcept C2781311116 @default.
- W2906128209 hasConcept C28826006 @default.
- W2906128209 hasConcept C33923547 @default.
- W2906128209 hasConcept C41008148 @default.
- W2906128209 hasConcept C43617362 @default.
- W2906128209 hasConcept C50644808 @default.
- W2906128209 hasConcept C62520636 @default.
- W2906128209 hasConcept C81184566 @default.
- W2906128209 hasConceptScore W2906128209C106487976 @default.
- W2906128209 hasConceptScore W2906128209C11413529 @default.
- W2906128209 hasConceptScore W2906128209C121332964 @default.
- W2906128209 hasConceptScore W2906128209C136886441 @default.
- W2906128209 hasConceptScore W2906128209C144024400 @default.
- W2906128209 hasConceptScore W2906128209C154945302 @default.
- W2906128209 hasConceptScore W2906128209C159694833 @default.
- W2906128209 hasConceptScore W2906128209C167431342 @default.
- W2906128209 hasConceptScore W2906128209C185592680 @default.
- W2906128209 hasConceptScore W2906128209C19165224 @default.
- W2906128209 hasConceptScore W2906128209C206688291 @default.
- W2906128209 hasConceptScore W2906128209C207467116 @default.
- W2906128209 hasConceptScore W2906128209C2524010 @default.
- W2906128209 hasConceptScore W2906128209C2781311116 @default.
- W2906128209 hasConceptScore W2906128209C28826006 @default.
- W2906128209 hasConceptScore W2906128209C33923547 @default.
- W2906128209 hasConceptScore W2906128209C41008148 @default.
- W2906128209 hasConceptScore W2906128209C43617362 @default.
- W2906128209 hasConceptScore W2906128209C50644808 @default.
- W2906128209 hasConceptScore W2906128209C62520636 @default.
- W2906128209 hasConceptScore W2906128209C81184566 @default.
- W2906128209 hasLocation W29061282091 @default.
- W2906128209 hasOpenAccess W2906128209 @default.
- W2906128209 hasPrimaryLocation W29061282091 @default.
- W2906128209 hasRelatedWork W1518768192 @default.
- W2906128209 hasRelatedWork W1978728449 @default.
- W2906128209 hasRelatedWork W1993554909 @default.
- W2906128209 hasRelatedWork W2000191957 @default.
- W2906128209 hasRelatedWork W2003829014 @default.
- W2906128209 hasRelatedWork W2017325601 @default.
- W2906128209 hasRelatedWork W2048559463 @default.
- W2906128209 hasRelatedWork W2064174303 @default.
- W2906128209 hasRelatedWork W2162057287 @default.
- W2906128209 hasRelatedWork W2179373226 @default.
- W2906128209 hasRelatedWork W2278767011 @default.
- W2906128209 hasRelatedWork W2345256851 @default.
- W2906128209 hasRelatedWork W2953099512 @default.
- W2906128209 hasRelatedWork W2962833704 @default.
- W2906128209 hasRelatedWork W2997595811 @default.
- W2906128209 hasRelatedWork W3007062627 @default.
- W2906128209 hasRelatedWork W3175476413 @default.
- W2906128209 hasRelatedWork W2183322853 @default.
- W2906128209 hasRelatedWork W2524574154 @default.
- W2906128209 hasRelatedWork W3150760120 @default.
- W2906128209 isParatext "false" @default.
- W2906128209 isRetracted "false" @default.
- W2906128209 magId "2906128209" @default.
- W2906128209 workType "article" @default.