Matches in SemOpenAlex for { <https://semopenalex.org/work/W4281666478> ?p ?o ?g. }
Showing items 1 to 72 of
72
with 100 items per page.
- W4281666478 abstract "When solving finite-sum minimization problems, two common alternatives to stochastic gradient descent (SGD) with theoretical benefits are random reshuffling (SGD-RR) and shuffle-once (SGD-SO), in which functions are sampled in cycles without replacement. Under a convenient stochastic noise approximation which holds experimentally, we study the stationary variances of the iterates of SGD, SGD-RR and SGD-SO, whose leading terms decrease in this order, and obtain simple approximations. To obtain our results, we study the power spectral density of the stochastic gradient noise sequences. Our analysis extends beyond SGD to SGD with momentum and to the stochastic Nesterov's accelerated gradient method. We perform experiments on quadratic objective functions to test the validity of our approximation and the correctness of our findings." @default.
- W4281666478 created "2022-06-13" @default.
- W4281666478 creator A5037609573 @default.
- W4281666478 date "2022-06-01" @default.
- W4281666478 modified "2023-09-24" @default.
- W4281666478 title "Computing the Variance of Shuffling Stochastic Gradient Algorithms via Power Spectral Density Analysis" @default.
- W4281666478 doi "https://doi.org/10.48550/arxiv.2206.00632" @default.
- W4281666478 hasPublicationYear "2022" @default.
- W4281666478 type Work @default.
- W4281666478 citedByCount "0" @default.
- W4281666478 crossrefType "posted-content" @default.
- W4281666478 hasAuthorship W4281666478A5037609573 @default.
- W4281666478 hasBestOaLocation W42816664781 @default.
- W4281666478 hasConcept C105795698 @default.
- W4281666478 hasConcept C11413529 @default.
- W4281666478 hasConcept C115961682 @default.
- W4281666478 hasConcept C126255220 @default.
- W4281666478 hasConcept C129844170 @default.
- W4281666478 hasConcept C134306372 @default.
- W4281666478 hasConcept C140479938 @default.
- W4281666478 hasConcept C154945302 @default.
- W4281666478 hasConcept C167927819 @default.
- W4281666478 hasConcept C168110828 @default.
- W4281666478 hasConcept C206688291 @default.
- W4281666478 hasConcept C2524010 @default.
- W4281666478 hasConcept C26517878 @default.
- W4281666478 hasConcept C28826006 @default.
- W4281666478 hasConcept C33923547 @default.
- W4281666478 hasConcept C38652104 @default.
- W4281666478 hasConcept C41008148 @default.
- W4281666478 hasConcept C50644808 @default.
- W4281666478 hasConcept C55439883 @default.
- W4281666478 hasConcept C55479107 @default.
- W4281666478 hasConcept C99498987 @default.
- W4281666478 hasConceptScore W4281666478C105795698 @default.
- W4281666478 hasConceptScore W4281666478C11413529 @default.
- W4281666478 hasConceptScore W4281666478C115961682 @default.
- W4281666478 hasConceptScore W4281666478C126255220 @default.
- W4281666478 hasConceptScore W4281666478C129844170 @default.
- W4281666478 hasConceptScore W4281666478C134306372 @default.
- W4281666478 hasConceptScore W4281666478C140479938 @default.
- W4281666478 hasConceptScore W4281666478C154945302 @default.
- W4281666478 hasConceptScore W4281666478C167927819 @default.
- W4281666478 hasConceptScore W4281666478C168110828 @default.
- W4281666478 hasConceptScore W4281666478C206688291 @default.
- W4281666478 hasConceptScore W4281666478C2524010 @default.
- W4281666478 hasConceptScore W4281666478C26517878 @default.
- W4281666478 hasConceptScore W4281666478C28826006 @default.
- W4281666478 hasConceptScore W4281666478C33923547 @default.
- W4281666478 hasConceptScore W4281666478C38652104 @default.
- W4281666478 hasConceptScore W4281666478C41008148 @default.
- W4281666478 hasConceptScore W4281666478C50644808 @default.
- W4281666478 hasConceptScore W4281666478C55439883 @default.
- W4281666478 hasConceptScore W4281666478C55479107 @default.
- W4281666478 hasConceptScore W4281666478C99498987 @default.
- W4281666478 hasLocation W42816664781 @default.
- W4281666478 hasLocation W42816664782 @default.
- W4281666478 hasOpenAccess W4281666478 @default.
- W4281666478 hasPrimaryLocation W42816664781 @default.
- W4281666478 hasRelatedWork W1482231432 @default.
- W4281666478 hasRelatedWork W2090568800 @default.
- W4281666478 hasRelatedWork W2385485542 @default.
- W4281666478 hasRelatedWork W2613544035 @default.
- W4281666478 hasRelatedWork W3107451544 @default.
- W4281666478 hasRelatedWork W3175862423 @default.
- W4281666478 hasRelatedWork W4281666478 @default.
- W4281666478 hasRelatedWork W4292121483 @default.
- W4281666478 hasRelatedWork W4324298800 @default.
- W4281666478 hasRelatedWork W4380358855 @default.
- W4281666478 isParatext "false" @default.
- W4281666478 isRetracted "false" @default.
- W4281666478 workType "article" @default.