Matches in SemOpenAlex for { <https://semopenalex.org/work/W2912488710> ?p ?o ?g. }
- W2912488710 abstract "Two new stochastic variance-reduced algorithms named SARAH and SPIDER have been recently proposed, and SPIDER has been shown to achieve a near-optimal gradient oracle complexity for nonconvex optimization. However, the theoretical advantage of SPIDER does not lead to substantial improvement of practical performance over SVRG. To address this issue, momentum technique can be a good candidate to improve the performance of SPIDER. However, existing momentum schemes used in variance-reduced algorithms are designed specifically for convex optimization, and are not applicable to nonconvex scenarios. In this paper, we develop novel momentum schemes with flexible coefficient settings to accelerate SPIDER for nonconvex and nonsmooth composite optimization, and show that the resulting algorithms achieve the near-optimal gradient oracle complexity for achieving a generalized first-order stationary condition. Furthermore, we generalize our algorithm to online nonconvex and nonsmooth optimization, and establish an oracle complexity result that matches the state-of-the-art. Our extensive experiments demonstrate the superior performance of our proposed algorithm over other stochastic variance-reduced algorithms." @default.
- W2912488710 created "2019-02-21" @default.
- W2912488710 creator A5020766546 @default.
- W2912488710 creator A5042048777 @default.
- W2912488710 creator A5044769501 @default.
- W2912488710 creator A5056053058 @default.
- W2912488710 creator A5071973105 @default.
- W2912488710 date "2019-02-07" @default.
- W2912488710 modified "2023-09-29" @default.
- W2912488710 title "Momentum Schemes with Stochastic Variance Reduction for Nonconvex Composite Optimization" @default.
- W2912488710 cites W114517082 @default.
- W2912488710 cites W1987083649 @default.
- W2912488710 cites W1994616650 @default.
- W2912488710 cites W2029463628 @default.
- W2912488710 cites W2047152541 @default.
- W2912488710 cites W205960364 @default.
- W2912488710 cites W2100556411 @default.
- W2912488710 cites W2101868363 @default.
- W2912488710 cites W2107438106 @default.
- W2912488710 cites W2127447444 @default.
- W2912488710 cites W2153635508 @default.
- W2912488710 cites W2556623528 @default.
- W2912488710 cites W2619167391 @default.
- W2912488710 cites W2884265051 @default.
- W2912488710 cites W2889576094 @default.
- W2912488710 cites W2894946750 @default.
- W2912488710 cites W2896285425 @default.
- W2912488710 cites W2898280890 @default.
- W2912488710 cites W2952215077 @default.
- W2912488710 cites W2962696654 @default.
- W2912488710 cites W2962734306 @default.
- W2912488710 cites W2962851402 @default.
- W2912488710 cites W2963156201 @default.
- W2912488710 cites W2963254131 @default.
- W2912488710 cites W2963263838 @default.
- W2912488710 cites W2963411541 @default.
- W2912488710 cites W2964291545 @default.
- W2912488710 cites W2968543285 @default.
- W2912488710 cites W3024655380 @default.
- W2912488710 cites W3141595720 @default.
- W2912488710 hasPublicationYear "2019" @default.
- W2912488710 type Work @default.
- W2912488710 sameAs 2912488710 @default.
- W2912488710 citedByCount "9" @default.
- W2912488710 countsByYear W29124887102019 @default.
- W2912488710 countsByYear W29124887102020 @default.
- W2912488710 countsByYear W29124887102021 @default.
- W2912488710 crossrefType "posted-content" @default.
- W2912488710 hasAuthorship W2912488710A5020766546 @default.
- W2912488710 hasAuthorship W2912488710A5042048777 @default.
- W2912488710 hasAuthorship W2912488710A5044769501 @default.
- W2912488710 hasAuthorship W2912488710A5056053058 @default.
- W2912488710 hasAuthorship W2912488710A5071973105 @default.
- W2912488710 hasConcept C10138342 @default.
- W2912488710 hasConcept C11413529 @default.
- W2912488710 hasConcept C115903868 @default.
- W2912488710 hasConcept C121955636 @default.
- W2912488710 hasConcept C126255220 @default.
- W2912488710 hasConcept C137836250 @default.
- W2912488710 hasConcept C144133560 @default.
- W2912488710 hasConcept C162324750 @default.
- W2912488710 hasConcept C194387892 @default.
- W2912488710 hasConcept C196083921 @default.
- W2912488710 hasConcept C33923547 @default.
- W2912488710 hasConcept C41008148 @default.
- W2912488710 hasConcept C55166926 @default.
- W2912488710 hasConcept C60718061 @default.
- W2912488710 hasConcept C62644790 @default.
- W2912488710 hasConceptScore W2912488710C10138342 @default.
- W2912488710 hasConceptScore W2912488710C11413529 @default.
- W2912488710 hasConceptScore W2912488710C115903868 @default.
- W2912488710 hasConceptScore W2912488710C121955636 @default.
- W2912488710 hasConceptScore W2912488710C126255220 @default.
- W2912488710 hasConceptScore W2912488710C137836250 @default.
- W2912488710 hasConceptScore W2912488710C144133560 @default.
- W2912488710 hasConceptScore W2912488710C162324750 @default.
- W2912488710 hasConceptScore W2912488710C194387892 @default.
- W2912488710 hasConceptScore W2912488710C196083921 @default.
- W2912488710 hasConceptScore W2912488710C33923547 @default.
- W2912488710 hasConceptScore W2912488710C41008148 @default.
- W2912488710 hasConceptScore W2912488710C55166926 @default.
- W2912488710 hasConceptScore W2912488710C60718061 @default.
- W2912488710 hasConceptScore W2912488710C62644790 @default.
- W2912488710 hasLocation W29124887101 @default.
- W2912488710 hasOpenAccess W2912488710 @default.
- W2912488710 hasPrimaryLocation W29124887101 @default.
- W2912488710 hasRelatedWork W1494085563 @default.
- W2912488710 hasRelatedWork W1987083649 @default.
- W2912488710 hasRelatedWork W1992208280 @default.
- W2912488710 hasRelatedWork W1994616650 @default.
- W2912488710 hasRelatedWork W2029463628 @default.
- W2912488710 hasRelatedWork W2107438106 @default.
- W2912488710 hasRelatedWork W2135482703 @default.
- W2912488710 hasRelatedWork W2596996085 @default.
- W2912488710 hasRelatedWork W2625685405 @default.
- W2912488710 hasRelatedWork W2781459145 @default.
- W2912488710 hasRelatedWork W2800682254 @default.
- W2912488710 hasRelatedWork W2962696654 @default.
- W2912488710 hasRelatedWork W2963156201 @default.
- W2912488710 hasRelatedWork W2963409219 @default.