Matches in SemOpenAlex for { <https://semopenalex.org/work/W3007735875> ?p ?o ?g. }
- W3007735875 abstract "We study Nesterov's accelerated gradient method with constant step-size and momentum parameters in the stochastic approximation setting (unbiased gradients with bounded variance) and the finite-sum setting (where randomness is due to sampling mini-batches). To build better insight into the behavior of Nesterov's method in stochastic settings, we focus throughout on objectives that are smooth, strongly-convex, and twice continuously differentiable. In the stochastic approximation setting, Nesterov's method converges to a neighborhood of the optimal point at the same accelerated rate as in the deterministic setting. Perhaps surprisingly, in the finite-sum setting, we prove that Nesterov's method may diverge with the usual choice of step-size and momentum, unless additional conditions on the problem related to conditioning and data coherence are satisfied. Our results shed light as to why Nesterov's method may fail to converge or achieve acceleration in the finite-sum setting." @default.
- W3007735875 created "2020-03-06" @default.
- W3007735875 creator A5006611401 @default.
- W3007735875 creator A5089819604 @default.
- W3007735875 date "2020-02-27" @default.
- W3007735875 modified "2023-10-01" @default.
- W3007735875 title "On the Convergence of Nesterov's Accelerated Gradient Method in Stochastic Settings" @default.
- W3007735875 cites W104184427 @default.
- W3007735875 cites W1568288633 @default.
- W3007735875 cites W1860742233 @default.
- W3007735875 cites W1916951228 @default.
- W3007735875 cites W1988720110 @default.
- W3007735875 cites W2023695846 @default.
- W3007735875 cites W2024484010 @default.
- W3007735875 cites W2032326995 @default.
- W3007735875 cites W2045744861 @default.
- W3007735875 cites W2061478235 @default.
- W3007735875 cites W2101234009 @default.
- W3007735875 cites W2121210949 @default.
- W3007735875 cites W2124450277 @default.
- W3007735875 cites W2124768887 @default.
- W3007735875 cites W2127447444 @default.
- W3007735875 cites W2168909589 @default.
- W3007735875 cites W2337540838 @default.
- W3007735875 cites W2528062157 @default.
- W3007735875 cites W2610857016 @default.
- W3007735875 cites W2780752111 @default.
- W3007735875 cites W2848500096 @default.
- W3007735875 cites W2884265051 @default.
- W3007735875 cites W2913357890 @default.
- W3007735875 cites W2944572616 @default.
- W3007735875 cites W2962795635 @default.
- W3007735875 cites W2963326510 @default.
- W3007735875 cites W2963433607 @default.
- W3007735875 cites W2963792515 @default.
- W3007735875 cites W2963811077 @default.
- W3007735875 cites W2963830794 @default.
- W3007735875 cites W2963834323 @default.
- W3007735875 cites W2963858717 @default.
- W3007735875 cites W2964102336 @default.
- W3007735875 cites W2964725673 @default.
- W3007735875 cites W2969451120 @default.
- W3007735875 cites W2970632286 @default.
- W3007735875 cites W2970948121 @default.
- W3007735875 cites W2971014566 @default.
- W3007735875 cites W2994635124 @default.
- W3007735875 cites W3008463948 @default.
- W3007735875 cites W3141595720 @default.
- W3007735875 hasPublicationYear "2020" @default.
- W3007735875 type Work @default.
- W3007735875 sameAs 3007735875 @default.
- W3007735875 citedByCount "3" @default.
- W3007735875 countsByYear W30077358752019 @default.
- W3007735875 countsByYear W30077358752020 @default.
- W3007735875 countsByYear W30077358752021 @default.
- W3007735875 crossrefType "posted-content" @default.
- W3007735875 hasAuthorship W3007735875A5006611401 @default.
- W3007735875 hasAuthorship W3007735875A5089819604 @default.
- W3007735875 hasConcept C10138342 @default.
- W3007735875 hasConcept C105795698 @default.
- W3007735875 hasConcept C112680207 @default.
- W3007735875 hasConcept C117896860 @default.
- W3007735875 hasConcept C121332964 @default.
- W3007735875 hasConcept C125112378 @default.
- W3007735875 hasConcept C126255220 @default.
- W3007735875 hasConcept C134306372 @default.
- W3007735875 hasConcept C145446738 @default.
- W3007735875 hasConcept C162324750 @default.
- W3007735875 hasConcept C199360897 @default.
- W3007735875 hasConcept C202615002 @default.
- W3007735875 hasConcept C2524010 @default.
- W3007735875 hasConcept C26517878 @default.
- W3007735875 hasConcept C2777027219 @default.
- W3007735875 hasConcept C2777303404 @default.
- W3007735875 hasConcept C28826006 @default.
- W3007735875 hasConcept C33923547 @default.
- W3007735875 hasConcept C34388435 @default.
- W3007735875 hasConcept C38652104 @default.
- W3007735875 hasConcept C41008148 @default.
- W3007735875 hasConcept C50522688 @default.
- W3007735875 hasConcept C55479107 @default.
- W3007735875 hasConcept C60718061 @default.
- W3007735875 hasConcept C74650414 @default.
- W3007735875 hasConceptScore W3007735875C10138342 @default.
- W3007735875 hasConceptScore W3007735875C105795698 @default.
- W3007735875 hasConceptScore W3007735875C112680207 @default.
- W3007735875 hasConceptScore W3007735875C117896860 @default.
- W3007735875 hasConceptScore W3007735875C121332964 @default.
- W3007735875 hasConceptScore W3007735875C125112378 @default.
- W3007735875 hasConceptScore W3007735875C126255220 @default.
- W3007735875 hasConceptScore W3007735875C134306372 @default.
- W3007735875 hasConceptScore W3007735875C145446738 @default.
- W3007735875 hasConceptScore W3007735875C162324750 @default.
- W3007735875 hasConceptScore W3007735875C199360897 @default.
- W3007735875 hasConceptScore W3007735875C202615002 @default.
- W3007735875 hasConceptScore W3007735875C2524010 @default.
- W3007735875 hasConceptScore W3007735875C26517878 @default.
- W3007735875 hasConceptScore W3007735875C2777027219 @default.
- W3007735875 hasConceptScore W3007735875C2777303404 @default.
- W3007735875 hasConceptScore W3007735875C28826006 @default.