FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3082446031> ?p ?o ?g. }

• W3082446031 abstract "The theory and practice of stochastic optimization has focused on stochastic gradient descent (SGD) in recent years, retaining the basic first-order stochastic nature of SGD while aiming to improve it via mechanisms such as averaging, momentum, and variance reduction. Improvement can be measured along various dimensions, however, and it has proved difficult to achieve improvements both in terms of nonasymptotic measures of convergence rate and asymptotic measures of distributional tightness. In this work, we consider first-order stochastic optimization from a general statistical point of view, motivating a specific form of recursive averaging of past stochastic gradients. The resulting algorithm, which we refer to as emph{Recursive One-Over-T SGD} (ROOT-SGD), matches the state-of-the-art convergence rate among online variance-reduced stochastic approximation methods. Moreover, under slightly stronger distributional assumptions, the rescaled last-iterate of ROOT-SGD converges to a zero-mean Gaussian distribution that achieves near-optimal covariance." @default.
• W3082446031 created "2020-09-08" @default.
• W3082446031 creator A5006742082 @default.
• W3082446031 creator A5038379562 @default.
• W3082446031 creator A5049812527 @default.
• W3082446031 creator A5058611209 @default.
• W3082446031 date "2020-08-28" @default.
• W3082446031 modified "2023-09-27" @default.
• W3082446031 title "ROOT-SGD: Sharp Nonasymptotics and Asymptotic Efficiency in a Single Algorithm." @default.
• W3082446031 cites W1499021337 @default.
• W3082446031 cites W1505731132 @default.
• W3082446031 cites W1516903196 @default.
• W3082446031 cites W1568229137 @default.
• W3082446031 cites W1569098853 @default.
• W3082446031 cites W1603765807 @default.
• W3082446031 cites W1939652453 @default.
• W3082446031 cites W1973240854 @default.
• W3082446031 cites W1980404857 @default.
• W3082446031 cites W1987083649 @default.
• W3082446031 cites W1992208280 @default.
• W3082446031 cites W1994616650 @default.
• W3082446031 cites W2045744861 @default.
• W3082446031 cites W2073750241 @default.
• W3082446031 cites W2076428552 @default.
• W3082446031 cites W2077723394 @default.
• W3082446031 cites W2086161653 @default.
• W3082446031 cites W2096840748 @default.
• W3082446031 cites W2105875671 @default.
• W3082446031 cites W2107438106 @default.
• W3082446031 cites W2112269233 @default.
• W3082446031 cites W2124768887 @default.
• W3082446031 cites W2135482703 @default.
• W3082446031 cites W2154682027 @default.
• W3082446031 cites W2156779765 @default.
• W3082446031 cites W2159930037 @default.
• W3082446031 cites W2168909589 @default.
• W3082446031 cites W2293647857 @default.
• W3082446031 cites W2545578326 @default.
• W3082446031 cites W2796196168 @default.
• W3082446031 cites W2808489849 @default.
• W3082446031 cites W2884265051 @default.
• W3082446031 cites W2885329750 @default.
• W3082446031 cites W2901718886 @default.
• W3082446031 cites W2962696654 @default.
• W3082446031 cites W2962956395 @default.
• W3082446031 cites W2963326510 @default.
• W3082446031 cites W2963411541 @default.
• W3082446031 cites W2963433607 @default.
• W3082446031 cites W2963470657 @default.
• W3082446031 cites W2963527706 @default.
• W3082446031 cites W2963646202 @default.
• W3082446031 cites W2964037929 @default.
• W3082446031 cites W2964066689 @default.
• W3082446031 cites W2964312760 @default.
• W3082446031 cites W2966734222 @default.
• W3082446031 cites W2970623506 @default.
• W3082446031 cites W2970850035 @default.
• W3082446031 cites W2997199030 @default.
• W3082446031 cites W3015241628 @default.
• W3082446031 cites W3024655380 @default.
• W3082446031 cites W3038605285 @default.
• W3082446031 cites W3039770199 @default.
• W3082446031 cites W3043072433 @default.
• W3082446031 cites W3046520696 @default.
• W3082446031 cites W3083194044 @default.
• W3082446031 cites W3128015591 @default.
• W3082446031 cites W3141595720 @default.
• W3082446031 cites W584312462 @default.
• W3082446031 cites W59018853 @default.
• W3082446031 cites W594357522 @default.
• W3082446031 cites W2961579901 @default.
• W3082446031 hasPublicationYear "2020" @default.
• W3082446031 type Work @default.
• W3082446031 sameAs 3082446031 @default.
• W3082446031 citedByCount "4" @default.
• W3082446031 countsByYear W30824460312020 @default.
• W3082446031 countsByYear W30824460312021 @default.
• W3082446031 crossrefType "posted-content" @default.
• W3082446031 hasAuthorship W3082446031A5006742082 @default.
• W3082446031 hasAuthorship W3082446031A5038379562 @default.
• W3082446031 hasAuthorship W3082446031A5049812527 @default.
• W3082446031 hasAuthorship W3082446031A5058611209 @default.
• W3082446031 hasConcept C105795698 @default.
• W3082446031 hasConcept C121332964 @default.
• W3082446031 hasConcept C121955636 @default.
• W3082446031 hasConcept C126255220 @default.
• W3082446031 hasConcept C144133560 @default.
• W3082446031 hasConcept C154945302 @default.
• W3082446031 hasConcept C162324750 @default.
• W3082446031 hasConcept C163716315 @default.
• W3082446031 hasConcept C178650346 @default.
• W3082446031 hasConcept C19499675 @default.
• W3082446031 hasConcept C196083921 @default.
• W3082446031 hasConcept C206688291 @default.
• W3082446031 hasConcept C26517878 @default.
• W3082446031 hasConcept C2777303404 @default.
• W3082446031 hasConcept C28826006 @default.
• W3082446031 hasConcept C33923547 @default.
• W3082446031 hasConcept C38652104 @default.
• W3082446031 hasConcept C41008148 @default.

• next