FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2912598912> ?p ?o ?g. }

• W2912598912 abstract "Recently it has been shown that the step sizes of a family of variance reduced gradient methods called the JacSketch methods depend on the expected smoothness constant. In particular, if this expected smoothness constant could be calculated a priori, then one could safely set much larger step sizes which would result in a much faster convergence rate. We fill in this gap, and provide simple closed form expressions for the expected smoothness constant and careful numerical experiments verifying these bounds. Using these bounds, and since the SAGA algorithm is part of this JacSketch family, we suggest a new standard practice for setting the step sizes and mini-batch size for SAGA that are competitive with a numerical grid search. Furthermore, we can now show that the total complexity of the SAGA algorithm decreases linearly in the mini-batch size up to a pre-defined value: the optimal mini-batch size. This is a rare result in the stochastic variance reduced literature, only previously shown for the Katyusha algorithm. Finally we conjecture that this is the case for many other stochastic variance reduced methods and that our bounds and analysis of the expected smoothness constant is key to extending these results." @default.
• W2912598912 created "2019-02-21" @default.
• W2912598912 creator A5002459856 @default.
• W2912598912 creator A5008334471 @default.
• W2912598912 creator A5051786081 @default.
• W2912598912 date "2019-01-31" @default.
• W2912598912 modified "2023-10-01" @default.
• W2912598912 title "Optimal mini-batch and step sizes for SAGA" @default.
• W2912598912 cites W1939652453 @default.
• W2912598912 cites W1959255040 @default.
• W2912598912 cites W1994616650 @default.
• W2912598912 cites W2103012681 @default.
• W2912598912 cites W2107438106 @default.
• W2912598912 cites W2153635508 @default.
• W2912598912 cites W2798675357 @default.
• W2912598912 cites W2799870997 @default.
• W2912598912 cites W2952215077 @default.
• W2912598912 cites W2962696654 @default.
• W2912598912 cites W2963087817 @default.
• W2912598912 cites W2963156201 @default.
• W2912598912 cites W2963455674 @default.
• W2912598912 cites W2963607709 @default.
• W2912598912 cites W2963942108 @default.
• W2912598912 cites W2964089577 @default.
• W2912598912 cites W2964112534 @default.
• W2912598912 cites W3120740533 @default.
• W2912598912 cites W3141595720 @default.
• W2912598912 hasPublicationYear "2019" @default.
• W2912598912 type Work @default.
• W2912598912 sameAs 2912598912 @default.
• W2912598912 citedByCount "12" @default.
• W2912598912 countsByYear W29125989122019 @default.
• W2912598912 countsByYear W29125989122020 @default.
• W2912598912 countsByYear W29125989122021 @default.
• W2912598912 crossrefType "posted-content" @default.
• W2912598912 hasAuthorship W2912598912A5002459856 @default.
• W2912598912 hasAuthorship W2912598912A5008334471 @default.
• W2912598912 hasAuthorship W2912598912A5051786081 @default.
• W2912598912 hasConcept C102634674 @default.
• W2912598912 hasConcept C105795698 @default.
• W2912598912 hasConcept C111472728 @default.
• W2912598912 hasConcept C11413529 @default.
• W2912598912 hasConcept C114614502 @default.
• W2912598912 hasConcept C121955636 @default.
• W2912598912 hasConcept C126255220 @default.
• W2912598912 hasConcept C134306372 @default.
• W2912598912 hasConcept C138885662 @default.
• W2912598912 hasConcept C141042865 @default.
• W2912598912 hasConcept C144133560 @default.
• W2912598912 hasConcept C162324750 @default.
• W2912598912 hasConcept C196083921 @default.
• W2912598912 hasConcept C199360897 @default.
• W2912598912 hasConcept C26517878 @default.
• W2912598912 hasConcept C2777027219 @default.
• W2912598912 hasConcept C2777303404 @default.
• W2912598912 hasConcept C2780586882 @default.
• W2912598912 hasConcept C2780990831 @default.
• W2912598912 hasConcept C28826006 @default.
• W2912598912 hasConcept C33923547 @default.
• W2912598912 hasConcept C38652104 @default.
• W2912598912 hasConcept C41008148 @default.
• W2912598912 hasConcept C50522688 @default.
• W2912598912 hasConcept C57869625 @default.
• W2912598912 hasConcept C75553542 @default.
• W2912598912 hasConceptScore W2912598912C102634674 @default.
• W2912598912 hasConceptScore W2912598912C105795698 @default.
• W2912598912 hasConceptScore W2912598912C111472728 @default.
• W2912598912 hasConceptScore W2912598912C11413529 @default.
• W2912598912 hasConceptScore W2912598912C114614502 @default.
• W2912598912 hasConceptScore W2912598912C121955636 @default.
• W2912598912 hasConceptScore W2912598912C126255220 @default.
• W2912598912 hasConceptScore W2912598912C134306372 @default.
• W2912598912 hasConceptScore W2912598912C138885662 @default.
• W2912598912 hasConceptScore W2912598912C141042865 @default.
• W2912598912 hasConceptScore W2912598912C144133560 @default.
• W2912598912 hasConceptScore W2912598912C162324750 @default.
• W2912598912 hasConceptScore W2912598912C196083921 @default.
• W2912598912 hasConceptScore W2912598912C199360897 @default.
• W2912598912 hasConceptScore W2912598912C26517878 @default.
• W2912598912 hasConceptScore W2912598912C2777027219 @default.
• W2912598912 hasConceptScore W2912598912C2777303404 @default.
• W2912598912 hasConceptScore W2912598912C2780586882 @default.
• W2912598912 hasConceptScore W2912598912C2780990831 @default.
• W2912598912 hasConceptScore W2912598912C28826006 @default.
• W2912598912 hasConceptScore W2912598912C33923547 @default.
• W2912598912 hasConceptScore W2912598912C38652104 @default.
• W2912598912 hasConceptScore W2912598912C41008148 @default.
• W2912598912 hasConceptScore W2912598912C50522688 @default.
• W2912598912 hasConceptScore W2912598912C57869625 @default.
• W2912598912 hasConceptScore W2912598912C75553542 @default.
• W2912598912 hasLocation W29125989121 @default.
• W2912598912 hasOpenAccess W2912598912 @default.
• W2912598912 hasPrimaryLocation W29125989121 @default.
• W2912598912 hasRelatedWork W1807715286 @default.
• W2912598912 hasRelatedWork W1992208280 @default.
• W2912598912 hasRelatedWork W2043800867 @default.
• W2912598912 hasRelatedWork W2107438106 @default.
• W2912598912 hasRelatedWork W2135482703 @default.
• W2912598912 hasRelatedWork W2153635508 @default.
• W2912598912 hasRelatedWork W2531478387 @default.

• next