Matches in SemOpenAlex for { <https://semopenalex.org/work/W3114508735> ?p ?o ?g. }
- W3114508735 abstract "In this work, we study the idea of variance reduction applied to adaptive stochastic mirror descent algorithms in the nonsmooth nonconvex finite-sum optimization problems. We propose a simple yet generalized adaptive mirror descent algorithm with variance reduction named SVRAMD and provide its convergence analysis in different settings. We prove that variance reduction reduces the SFO complexity of most adaptive mirror descent algorithms and accelerates their convergence. In particular, our general theory implies that variance reduction can be applied to algorithms using time-varying step sizes and self-adaptive algorithms such as AdaGrad and RMSProp. Moreover, the convergence rates of SVRAMD recover the best existing rates of non-adaptive variance reduced mirror descent algorithms. We check the validity of our claims using experiments in deep learning." @default.
- W3114508735 created "2021-01-05" @default.
- W3114508735 creator A5015199708 @default.
- W3114508735 creator A5037384664 @default.
- W3114508735 creator A5042490620 @default.
- W3114508735 creator A5056630426 @default.
- W3114508735 date "2020-12-26" @default.
- W3114508735 modified "2023-09-27" @default.
- W3114508735 title "Variance Reduction on Adaptive Stochastic Mirror Descent." @default.
- W3114508735 cites W131378802 @default.
- W3114508735 cites W1560724230 @default.
- W3114508735 cites W2107438106 @default.
- W3114508735 cites W2112796928 @default.
- W3114508735 cites W2146502635 @default.
- W3114508735 cites W2194775991 @default.
- W3114508735 cites W2304667012 @default.
- W3114508735 cites W2514742857 @default.
- W3114508735 cites W2518108298 @default.
- W3114508735 cites W2556623528 @default.
- W3114508735 cites W2728499573 @default.
- W3114508735 cites W2785523195 @default.
- W3114508735 cites W2886463271 @default.
- W3114508735 cites W2943091211 @default.
- W3114508735 cites W2950850251 @default.
- W3114508735 cites W2952215077 @default.
- W3114508735 cites W2963248893 @default.
- W3114508735 cites W2963411541 @default.
- W3114508735 cites W2963545805 @default.
- W3114508735 cites W2964121744 @default.
- W3114508735 cites W2998272627 @default.
- W3114508735 cites W2787172500 @default.
- W3114508735 hasPublicationYear "2020" @default.
- W3114508735 type Work @default.
- W3114508735 sameAs 3114508735 @default.
- W3114508735 citedByCount "1" @default.
- W3114508735 countsByYear W31145087352021 @default.
- W3114508735 crossrefType "posted-content" @default.
- W3114508735 hasAuthorship W3114508735A5015199708 @default.
- W3114508735 hasAuthorship W3114508735A5037384664 @default.
- W3114508735 hasAuthorship W3114508735A5042490620 @default.
- W3114508735 hasAuthorship W3114508735A5056630426 @default.
- W3114508735 hasConcept C111335779 @default.
- W3114508735 hasConcept C11413529 @default.
- W3114508735 hasConcept C121955636 @default.
- W3114508735 hasConcept C126255220 @default.
- W3114508735 hasConcept C127413603 @default.
- W3114508735 hasConcept C144133560 @default.
- W3114508735 hasConcept C146978453 @default.
- W3114508735 hasConcept C153258448 @default.
- W3114508735 hasConcept C154945302 @default.
- W3114508735 hasConcept C162324750 @default.
- W3114508735 hasConcept C196083921 @default.
- W3114508735 hasConcept C206688291 @default.
- W3114508735 hasConcept C2524010 @default.
- W3114508735 hasConcept C2776637919 @default.
- W3114508735 hasConcept C2777303404 @default.
- W3114508735 hasConcept C33923547 @default.
- W3114508735 hasConcept C41008148 @default.
- W3114508735 hasConcept C50522688 @default.
- W3114508735 hasConcept C50644808 @default.
- W3114508735 hasConcept C62644790 @default.
- W3114508735 hasConceptScore W3114508735C111335779 @default.
- W3114508735 hasConceptScore W3114508735C11413529 @default.
- W3114508735 hasConceptScore W3114508735C121955636 @default.
- W3114508735 hasConceptScore W3114508735C126255220 @default.
- W3114508735 hasConceptScore W3114508735C127413603 @default.
- W3114508735 hasConceptScore W3114508735C144133560 @default.
- W3114508735 hasConceptScore W3114508735C146978453 @default.
- W3114508735 hasConceptScore W3114508735C153258448 @default.
- W3114508735 hasConceptScore W3114508735C154945302 @default.
- W3114508735 hasConceptScore W3114508735C162324750 @default.
- W3114508735 hasConceptScore W3114508735C196083921 @default.
- W3114508735 hasConceptScore W3114508735C206688291 @default.
- W3114508735 hasConceptScore W3114508735C2524010 @default.
- W3114508735 hasConceptScore W3114508735C2776637919 @default.
- W3114508735 hasConceptScore W3114508735C2777303404 @default.
- W3114508735 hasConceptScore W3114508735C33923547 @default.
- W3114508735 hasConceptScore W3114508735C41008148 @default.
- W3114508735 hasConceptScore W3114508735C50522688 @default.
- W3114508735 hasConceptScore W3114508735C50644808 @default.
- W3114508735 hasConceptScore W3114508735C62644790 @default.
- W3114508735 hasLocation W31145087351 @default.
- W3114508735 hasOpenAccess W3114508735 @default.
- W3114508735 hasPrimaryLocation W31145087351 @default.
- W3114508735 hasRelatedWork W2097568041 @default.
- W3114508735 hasRelatedWork W2534068475 @default.
- W3114508735 hasRelatedWork W2555215491 @default.
- W3114508735 hasRelatedWork W2560283133 @default.
- W3114508735 hasRelatedWork W2593298160 @default.
- W3114508735 hasRelatedWork W2766636532 @default.
- W3114508735 hasRelatedWork W2768950724 @default.
- W3114508735 hasRelatedWork W2787998652 @default.
- W3114508735 hasRelatedWork W2914360004 @default.
- W3114508735 hasRelatedWork W3034547948 @default.
- W3114508735 hasRelatedWork W3034995656 @default.
- W3114508735 hasRelatedWork W3036735840 @default.
- W3114508735 hasRelatedWork W305874333 @default.
- W3114508735 hasRelatedWork W3091372384 @default.
- W3114508735 hasRelatedWork W3093948424 @default.
- W3114508735 hasRelatedWork W3097919408 @default.