Matches in SemOpenAlex for { <https://semopenalex.org/work/W3210748558> ?p ?o ?g. }
Showing items 1 to 93 of
93
with 100 items per page.
- W3210748558 abstract "Momentum methods are popularly used in accelerating stochastic iterative methods. Although a fair amount of literature is dedicated to momentum in stochastic optimisation, there are limited results that quantify the benefits of using heavy ball momentum in the specific case of stochastic approximation algorithms. We first show that the convergence rate with optimal step size does not improve when momentum is used (under some assumptions). Secondly, to quantify the behaviour in the initial phase we analyse the sample complexity of iterates with and without momentum. We show that the sample complexity bound for SA without momentum is $tilde{mathcal{O}}(frac{1}{alphalambda_{min}(A)})$ while for SA with momentum is $tilde{mathcal{O}}(frac{1}{sqrt{alphalambda_{min}(A)}})$, where $alpha$ is the step size and $lambda_{min}(A)$ is the smallest eigenvalue of the driving matrix $A$. Although the sample complexity bound for SA with momentum is better for small enough $alpha$, it turns out that for optimal choice of $alpha$ in the two cases, the sample complexity bounds are of the same order." @default.
- W3210748558 created "2021-11-08" @default.
- W3210748558 creator A5032887751 @default.
- W3210748558 creator A5047138399 @default.
- W3210748558 creator A5067048881 @default.
- W3210748558 creator A5069463876 @default.
- W3210748558 date "2021-10-29" @default.
- W3210748558 modified "2023-09-27" @default.
- W3210748558 title "Does Momentum Help? A Sample Complexity Analysis" @default.
- W3210748558 cites W1568229137 @default.
- W3210748558 cites W1972711404 @default.
- W3210748558 cites W1988720110 @default.
- W3210748558 cites W2066623346 @default.
- W3210748558 cites W2184204218 @default.
- W3210748558 cites W2890773834 @default.
- W3210748558 cites W2896101215 @default.
- W3210748558 cites W2950882283 @default.
- W3210748558 cites W2964121744 @default.
- W3210748558 cites W2966363432 @default.
- W3210748558 cites W2982701380 @default.
- W3210748558 cites W2993442395 @default.
- W3210748558 cites W3004770624 @default.
- W3210748558 cites W3015956888 @default.
- W3210748558 cites W3034558699 @default.
- W3210748558 cites W594357522 @default.
- W3210748558 hasPublicationYear "2021" @default.
- W3210748558 type Work @default.
- W3210748558 sameAs 3210748558 @default.
- W3210748558 citedByCount "0" @default.
- W3210748558 crossrefType "posted-content" @default.
- W3210748558 hasAuthorship W3210748558A5032887751 @default.
- W3210748558 hasAuthorship W3210748558A5047138399 @default.
- W3210748558 hasAuthorship W3210748558A5067048881 @default.
- W3210748558 hasAuthorship W3210748558A5069463876 @default.
- W3210748558 hasConcept C10138342 @default.
- W3210748558 hasConcept C105795698 @default.
- W3210748558 hasConcept C114614502 @default.
- W3210748558 hasConcept C121332964 @default.
- W3210748558 hasConcept C122041747 @default.
- W3210748558 hasConcept C129848803 @default.
- W3210748558 hasConcept C134306372 @default.
- W3210748558 hasConcept C140479938 @default.
- W3210748558 hasConcept C162324750 @default.
- W3210748558 hasConcept C182306322 @default.
- W3210748558 hasConcept C2778113609 @default.
- W3210748558 hasConcept C33923547 @default.
- W3210748558 hasConcept C37914503 @default.
- W3210748558 hasConcept C60718061 @default.
- W3210748558 hasConcept C62520636 @default.
- W3210748558 hasConcept C77553402 @default.
- W3210748558 hasConceptScore W3210748558C10138342 @default.
- W3210748558 hasConceptScore W3210748558C105795698 @default.
- W3210748558 hasConceptScore W3210748558C114614502 @default.
- W3210748558 hasConceptScore W3210748558C121332964 @default.
- W3210748558 hasConceptScore W3210748558C122041747 @default.
- W3210748558 hasConceptScore W3210748558C129848803 @default.
- W3210748558 hasConceptScore W3210748558C134306372 @default.
- W3210748558 hasConceptScore W3210748558C140479938 @default.
- W3210748558 hasConceptScore W3210748558C162324750 @default.
- W3210748558 hasConceptScore W3210748558C182306322 @default.
- W3210748558 hasConceptScore W3210748558C2778113609 @default.
- W3210748558 hasConceptScore W3210748558C33923547 @default.
- W3210748558 hasConceptScore W3210748558C37914503 @default.
- W3210748558 hasConceptScore W3210748558C60718061 @default.
- W3210748558 hasConceptScore W3210748558C62520636 @default.
- W3210748558 hasConceptScore W3210748558C77553402 @default.
- W3210748558 hasLocation W32107485581 @default.
- W3210748558 hasOpenAccess W3210748558 @default.
- W3210748558 hasPrimaryLocation W32107485581 @default.
- W3210748558 hasRelatedWork W1866529865 @default.
- W3210748558 hasRelatedWork W2000114801 @default.
- W3210748558 hasRelatedWork W2097216511 @default.
- W3210748558 hasRelatedWork W2122701159 @default.
- W3210748558 hasRelatedWork W2524027923 @default.
- W3210748558 hasRelatedWork W2598300585 @default.
- W3210748558 hasRelatedWork W2613688792 @default.
- W3210748558 hasRelatedWork W2756416768 @default.
- W3210748558 hasRelatedWork W2794456577 @default.
- W3210748558 hasRelatedWork W2911682014 @default.
- W3210748558 hasRelatedWork W2932056480 @default.
- W3210748558 hasRelatedWork W2949521664 @default.
- W3210748558 hasRelatedWork W2952131701 @default.
- W3210748558 hasRelatedWork W3004988528 @default.
- W3210748558 hasRelatedWork W3105933917 @default.
- W3210748558 hasRelatedWork W3113827893 @default.
- W3210748558 hasRelatedWork W3171154020 @default.
- W3210748558 hasRelatedWork W3176585907 @default.
- W3210748558 hasRelatedWork W3203654258 @default.
- W3210748558 hasRelatedWork W3214129522 @default.
- W3210748558 isParatext "false" @default.
- W3210748558 isRetracted "false" @default.
- W3210748558 magId "3210748558" @default.
- W3210748558 workType "article" @default.