Matches in SemOpenAlex for { <https://semopenalex.org/work/W3025843913> ?p ?o ?g. }
- W3025843913 abstract "Composition optimization is widely-applied in nonconvex machine learning. Various advanced stochastic algorithms that adopt momentum and variance reduction techniques have been developed for composition optimization. However, these algorithms do not fully exploit both techniques to accelerate the convergence and are lack of convergence guarantee in nonconvex optimization. This paper complements the existing literature by developing various momentum schemes with SPIDER-based variance reduction for non-convex composition optimization. In particular, our momentum design requires less number of proximal mapping evaluations per-iteration than that required by the existing Katyusha momentum. Furthermore, our algorithm achieves near-optimal sample complexity results in both non-convex finite-sum and online composition optimization and achieves a linear convergence rate under the gradient dominant condition. Numerical experiments demonstrate that our algorithm converges significantly faster than existing algorithms in nonconvex composition optimization." @default.
- W3025843913 created "2020-05-21" @default.
- W3025843913 creator A5031337173 @default.
- W3025843913 creator A5044769501 @default.
- W3025843913 date "2020-05-15" @default.
- W3025843913 modified "2023-09-24" @default.
- W3025843913 title "Momentum with Variance Reduction for Nonconvex Composition Optimization" @default.
- W3025843913 cites W1494085563 @default.
- W3025843913 cites W2105875671 @default.
- W3025843913 cites W2107438106 @default.
- W3025843913 cites W2157444450 @default.
- W3025843913 cites W2556623528 @default.
- W3025843913 cites W2619167391 @default.
- W3025843913 cites W2765393021 @default.
- W3025843913 cites W2770638430 @default.
- W3025843913 cites W2884265051 @default.
- W3025843913 cites W2889576094 @default.
- W3025843913 cites W2942057781 @default.
- W3025843913 cites W2944913783 @default.
- W3025843913 cites W2952215077 @default.
- W3025843913 cites W2962696654 @default.
- W3025843913 cites W2962734306 @default.
- W3025843913 cites W2962851402 @default.
- W3025843913 cites W2963008041 @default.
- W3025843913 cites W2963411541 @default.
- W3025843913 cites W2963545805 @default.
- W3025843913 cites W2963614065 @default.
- W3025843913 cites W2963965485 @default.
- W3025843913 cites W2964255842 @default.
- W3025843913 cites W2970527576 @default.
- W3025843913 cites W2970821315 @default.
- W3025843913 cites W2981439104 @default.
- W3025843913 cites W2986436577 @default.
- W3025843913 cites W2989715069 @default.
- W3025843913 cites W3039770199 @default.
- W3025843913 cites W3154049590 @default.
- W3025843913 hasPublicationYear "2020" @default.
- W3025843913 type Work @default.
- W3025843913 sameAs 3025843913 @default.
- W3025843913 citedByCount "2" @default.
- W3025843913 countsByYear W30258439132019 @default.
- W3025843913 countsByYear W30258439132020 @default.
- W3025843913 crossrefType "posted-content" @default.
- W3025843913 hasAuthorship W3025843913A5031337173 @default.
- W3025843913 hasAuthorship W3025843913A5044769501 @default.
- W3025843913 hasConcept C10138342 @default.
- W3025843913 hasConcept C105795698 @default.
- W3025843913 hasConcept C111335779 @default.
- W3025843913 hasConcept C112680207 @default.
- W3025843913 hasConcept C11413529 @default.
- W3025843913 hasConcept C121955636 @default.
- W3025843913 hasConcept C126255220 @default.
- W3025843913 hasConcept C127162648 @default.
- W3025843913 hasConcept C137836250 @default.
- W3025843913 hasConcept C138885662 @default.
- W3025843913 hasConcept C144133560 @default.
- W3025843913 hasConcept C157972887 @default.
- W3025843913 hasConcept C162324750 @default.
- W3025843913 hasConcept C19499675 @default.
- W3025843913 hasConcept C196083921 @default.
- W3025843913 hasConcept C2524010 @default.
- W3025843913 hasConcept C2777303404 @default.
- W3025843913 hasConcept C31258907 @default.
- W3025843913 hasConcept C33923547 @default.
- W3025843913 hasConcept C40231798 @default.
- W3025843913 hasConcept C41008148 @default.
- W3025843913 hasConcept C41895202 @default.
- W3025843913 hasConcept C50522688 @default.
- W3025843913 hasConcept C57869625 @default.
- W3025843913 hasConcept C60718061 @default.
- W3025843913 hasConcept C62644790 @default.
- W3025843913 hasConceptScore W3025843913C10138342 @default.
- W3025843913 hasConceptScore W3025843913C105795698 @default.
- W3025843913 hasConceptScore W3025843913C111335779 @default.
- W3025843913 hasConceptScore W3025843913C112680207 @default.
- W3025843913 hasConceptScore W3025843913C11413529 @default.
- W3025843913 hasConceptScore W3025843913C121955636 @default.
- W3025843913 hasConceptScore W3025843913C126255220 @default.
- W3025843913 hasConceptScore W3025843913C127162648 @default.
- W3025843913 hasConceptScore W3025843913C137836250 @default.
- W3025843913 hasConceptScore W3025843913C138885662 @default.
- W3025843913 hasConceptScore W3025843913C144133560 @default.
- W3025843913 hasConceptScore W3025843913C157972887 @default.
- W3025843913 hasConceptScore W3025843913C162324750 @default.
- W3025843913 hasConceptScore W3025843913C19499675 @default.
- W3025843913 hasConceptScore W3025843913C196083921 @default.
- W3025843913 hasConceptScore W3025843913C2524010 @default.
- W3025843913 hasConceptScore W3025843913C2777303404 @default.
- W3025843913 hasConceptScore W3025843913C31258907 @default.
- W3025843913 hasConceptScore W3025843913C33923547 @default.
- W3025843913 hasConceptScore W3025843913C40231798 @default.
- W3025843913 hasConceptScore W3025843913C41008148 @default.
- W3025843913 hasConceptScore W3025843913C41895202 @default.
- W3025843913 hasConceptScore W3025843913C50522688 @default.
- W3025843913 hasConceptScore W3025843913C57869625 @default.
- W3025843913 hasConceptScore W3025843913C60718061 @default.
- W3025843913 hasConceptScore W3025843913C62644790 @default.
- W3025843913 hasLocation W30258439131 @default.
- W3025843913 hasOpenAccess W3025843913 @default.
- W3025843913 hasPrimaryLocation W30258439131 @default.