Matches in SemOpenAlex for { <https://semopenalex.org/work/W2896572968> ?p ?o ?g. }
- W2896572968 abstract "We study the convergence of Stochastic Gradient Descent (SGD) for strongly convex objective functions. We prove for all $t$ a lower bound on the expected convergence rate after the $t$-th SGD iteration; the lower bound is over all possible sequences of diminishing step sizes. It implies that recently proposed sequences of step sizes at ICML 2018 and ICML 2019 are {em universally} close to optimal in that the expected convergence rate after {em each} iteration is within a factor $32$ of our lower bound. This factor is independent of dimension $d$. We offer a framework for comparing with lower bounds in state-of-the-art literature and when applied to SGD for strongly convex objective functions our lower bound is a significant factor $775cdot d$ larger compared to existing work." @default.
- W2896572968 created "2018-10-26" @default.
- W2896572968 creator A5049043092 @default.
- W2896572968 creator A5061545468 @default.
- W2896572968 creator A5075756968 @default.
- W2896572968 date "2018-10-10" @default.
- W2896572968 modified "2023-09-27" @default.
- W2896572968 title "Tight Dimension Independent Lower Bound on the Expected Convergence Rate for Diminishing Step Sizes in SGD" @default.
- W2896572968 cites W104184427 @default.
- W2896572968 cites W1505731132 @default.
- W2896572968 cites W1522301498 @default.
- W2896572968 cites W1554944419 @default.
- W2896572968 cites W1916951228 @default.
- W2896572968 cites W1994616650 @default.
- W2896572968 cites W2004060143 @default.
- W2896572968 cites W2099111195 @default.
- W2896572968 cites W2105875671 @default.
- W2896572968 cites W2107438106 @default.
- W2896572968 cites W2135482703 @default.
- W2896572968 cites W2146502635 @default.
- W2896572968 cites W2155192981 @default.
- W2896572968 cites W2156779765 @default.
- W2896572968 cites W2296319761 @default.
- W2896572968 cites W2436219157 @default.
- W2896572968 cites W2594182398 @default.
- W2896572968 cites W2783257164 @default.
- W2896572968 cites W2798766386 @default.
- W2896572968 cites W2902905070 @default.
- W2896572968 cites W2912205739 @default.
- W2896572968 cites W2952189730 @default.
- W2896572968 cites W2963335821 @default.
- W2896572968 cites W2963698657 @default.
- W2896572968 cites W3029645440 @default.
- W2896572968 cites W3141595720 @default.
- W2896572968 hasPublicationYear "2018" @default.
- W2896572968 type Work @default.
- W2896572968 sameAs 2896572968 @default.
- W2896572968 citedByCount "2" @default.
- W2896572968 countsByYear W28965729682019 @default.
- W2896572968 countsByYear W28965729682021 @default.
- W2896572968 crossrefType "posted-content" @default.
- W2896572968 hasAuthorship W2896572968A5049043092 @default.
- W2896572968 hasAuthorship W2896572968A5061545468 @default.
- W2896572968 hasAuthorship W2896572968A5075756968 @default.
- W2896572968 hasConcept C112680207 @default.
- W2896572968 hasConcept C114614502 @default.
- W2896572968 hasConcept C126255220 @default.
- W2896572968 hasConcept C127162648 @default.
- W2896572968 hasConcept C134306372 @default.
- W2896572968 hasConcept C145446738 @default.
- W2896572968 hasConcept C154945302 @default.
- W2896572968 hasConcept C162324750 @default.
- W2896572968 hasConcept C206688291 @default.
- W2896572968 hasConcept C2524010 @default.
- W2896572968 hasConcept C2777303404 @default.
- W2896572968 hasConcept C28826006 @default.
- W2896572968 hasConcept C31258907 @default.
- W2896572968 hasConcept C33676613 @default.
- W2896572968 hasConcept C33923547 @default.
- W2896572968 hasConcept C41008148 @default.
- W2896572968 hasConcept C50522688 @default.
- W2896572968 hasConcept C50644808 @default.
- W2896572968 hasConcept C57869625 @default.
- W2896572968 hasConcept C77553402 @default.
- W2896572968 hasConceptScore W2896572968C112680207 @default.
- W2896572968 hasConceptScore W2896572968C114614502 @default.
- W2896572968 hasConceptScore W2896572968C126255220 @default.
- W2896572968 hasConceptScore W2896572968C127162648 @default.
- W2896572968 hasConceptScore W2896572968C134306372 @default.
- W2896572968 hasConceptScore W2896572968C145446738 @default.
- W2896572968 hasConceptScore W2896572968C154945302 @default.
- W2896572968 hasConceptScore W2896572968C162324750 @default.
- W2896572968 hasConceptScore W2896572968C206688291 @default.
- W2896572968 hasConceptScore W2896572968C2524010 @default.
- W2896572968 hasConceptScore W2896572968C2777303404 @default.
- W2896572968 hasConceptScore W2896572968C28826006 @default.
- W2896572968 hasConceptScore W2896572968C31258907 @default.
- W2896572968 hasConceptScore W2896572968C33676613 @default.
- W2896572968 hasConceptScore W2896572968C33923547 @default.
- W2896572968 hasConceptScore W2896572968C41008148 @default.
- W2896572968 hasConceptScore W2896572968C50522688 @default.
- W2896572968 hasConceptScore W2896572968C50644808 @default.
- W2896572968 hasConceptScore W2896572968C57869625 @default.
- W2896572968 hasConceptScore W2896572968C77553402 @default.
- W2896572968 hasLocation W28965729681 @default.
- W2896572968 hasOpenAccess W2896572968 @default.
- W2896572968 hasPrimaryLocation W28965729681 @default.
- W2896572968 hasRelatedWork W1866529865 @default.
- W2896572968 hasRelatedWork W2811201469 @default.
- W2896572968 hasRelatedWork W2940467104 @default.
- W2896572968 hasRelatedWork W2945947591 @default.
- W2896572968 hasRelatedWork W2949088119 @default.
- W2896572968 hasRelatedWork W2950397435 @default.
- W2896572968 hasRelatedWork W2963834323 @default.
- W2896572968 hasRelatedWork W2970894719 @default.
- W2896572968 hasRelatedWork W2971899460 @default.
- W2896572968 hasRelatedWork W2981302852 @default.
- W2896572968 hasRelatedWork W2982634085 @default.
- W2896572968 hasRelatedWork W2997199030 @default.
- W2896572968 hasRelatedWork W3009274618 @default.