Matches in SemOpenAlex for { <https://semopenalex.org/work/W2970154823> ?p ?o ?g. }
Showing items 1 to 96 of
96
with 100 items per page.
- W2970154823 abstract "Natural gradient descent, which preconditions a gradient descent update with the Fisher information matrix of the underlying statistical model, is a way to capture partial second-order information. Several highly visible works have advocated an approximation known as the empirical Fisher, drawing connections between approximate second-order methods and heuristics like Adam. We dispute this argument by showing that the empirical Fisher---unlike the Fisher---does not generally capture second-order information. We further argue that the conditions under which the empirical Fisher approaches the Fisher (and the Hessian) are unlikely to be met in practice, and that, even on simple optimization problems, the pathologies of the empirical Fisher can have undesirable effects." @default.
- W2970154823 created "2019-09-05" @default.
- W2970154823 creator A5016638898 @default.
- W2970154823 creator A5022872779 @default.
- W2970154823 creator A5047338615 @default.
- W2970154823 date "2019-05-29" @default.
- W2970154823 modified "2023-09-27" @default.
- W2970154823 title "Limitations of the Empirical Fisher Approximation." @default.
- W2970154823 cites W1554944419 @default.
- W2970154823 cites W1598497354 @default.
- W2970154823 cites W196761320 @default.
- W2970154823 cites W1969810729 @default.
- W2970154823 cites W2020107577 @default.
- W2970154823 cites W2069244712 @default.
- W2970154823 cites W2120420045 @default.
- W2970154823 cites W2151965738 @default.
- W2970154823 cites W2155894447 @default.
- W2970154823 cites W2785940809 @default.
- W2970154823 cites W2895871047 @default.
- W2970154823 cites W2962739609 @default.
- W2970154823 cites W2962781217 @default.
- W2970154823 cites W2962913334 @default.
- W2970154823 cites W2963344792 @default.
- W2970154823 cites W2963433607 @default.
- W2970154823 cites W2964121744 @default.
- W2970154823 cites W3086499488 @default.
- W2970154823 hasPublicationYear "2019" @default.
- W2970154823 type Work @default.
- W2970154823 sameAs 2970154823 @default.
- W2970154823 citedByCount "16" @default.
- W2970154823 countsByYear W29701548232019 @default.
- W2970154823 countsByYear W29701548232020 @default.
- W2970154823 countsByYear W29701548232021 @default.
- W2970154823 crossrefType "posted-content" @default.
- W2970154823 hasAuthorship W2970154823A5016638898 @default.
- W2970154823 hasAuthorship W2970154823A5022872779 @default.
- W2970154823 hasAuthorship W2970154823A5047338615 @default.
- W2970154823 hasConcept C105795698 @default.
- W2970154823 hasConcept C122280245 @default.
- W2970154823 hasConcept C12267149 @default.
- W2970154823 hasConcept C126255220 @default.
- W2970154823 hasConcept C127705205 @default.
- W2970154823 hasConcept C144237770 @default.
- W2970154823 hasConcept C149782125 @default.
- W2970154823 hasConcept C154945302 @default.
- W2970154823 hasConcept C181367576 @default.
- W2970154823 hasConcept C203616005 @default.
- W2970154823 hasConcept C207798031 @default.
- W2970154823 hasConcept C28826006 @default.
- W2970154823 hasConcept C29406490 @default.
- W2970154823 hasConcept C33923547 @default.
- W2970154823 hasConcept C41008148 @default.
- W2970154823 hasConcept C83282275 @default.
- W2970154823 hasConceptScore W2970154823C105795698 @default.
- W2970154823 hasConceptScore W2970154823C122280245 @default.
- W2970154823 hasConceptScore W2970154823C12267149 @default.
- W2970154823 hasConceptScore W2970154823C126255220 @default.
- W2970154823 hasConceptScore W2970154823C127705205 @default.
- W2970154823 hasConceptScore W2970154823C144237770 @default.
- W2970154823 hasConceptScore W2970154823C149782125 @default.
- W2970154823 hasConceptScore W2970154823C154945302 @default.
- W2970154823 hasConceptScore W2970154823C181367576 @default.
- W2970154823 hasConceptScore W2970154823C203616005 @default.
- W2970154823 hasConceptScore W2970154823C207798031 @default.
- W2970154823 hasConceptScore W2970154823C28826006 @default.
- W2970154823 hasConceptScore W2970154823C29406490 @default.
- W2970154823 hasConceptScore W2970154823C33923547 @default.
- W2970154823 hasConceptScore W2970154823C41008148 @default.
- W2970154823 hasConceptScore W2970154823C83282275 @default.
- W2970154823 hasLocation W29701548231 @default.
- W2970154823 hasOpenAccess W2970154823 @default.
- W2970154823 hasPrimaryLocation W29701548231 @default.
- W2970154823 hasRelatedWork W158745526 @default.
- W2970154823 hasRelatedWork W196761320 @default.
- W2970154823 hasRelatedWork W2006478640 @default.
- W2970154823 hasRelatedWork W2044147389 @default.
- W2970154823 hasRelatedWork W2162404248 @default.
- W2970154823 hasRelatedWork W2194775991 @default.
- W2970154823 hasRelatedWork W2320938586 @default.
- W2970154823 hasRelatedWork W2335501264 @default.
- W2970154823 hasRelatedWork W2338882310 @default.
- W2970154823 hasRelatedWork W2500237691 @default.
- W2970154823 hasRelatedWork W2809090039 @default.
- W2970154823 hasRelatedWork W2933667566 @default.
- W2970154823 hasRelatedWork W2953381417 @default.
- W2970154823 hasRelatedWork W2964121744 @default.
- W2970154823 hasRelatedWork W2964125128 @default.
- W2970154823 hasRelatedWork W2964309400 @default.
- W2970154823 hasRelatedWork W3086499488 @default.
- W2970154823 hasRelatedWork W3192046682 @default.
- W2970154823 hasRelatedWork W2125518845 @default.
- W2970154823 hasRelatedWork W2529515167 @default.
- W2970154823 isParatext "false" @default.
- W2970154823 isRetracted "false" @default.
- W2970154823 magId "2970154823" @default.
- W2970154823 workType "article" @default.