Matches in SemOpenAlex for { <https://semopenalex.org/work/W4226285890> ?p ?o ?g. }
Showing items 1 to 58 of
58
with 100 items per page.
- W4226285890 abstract "We consider straggler-resilient learning. In many previous works, e.g., in the coded computing literature, straggling is modeled as random delays that are independent and identically distributed between workers. However, in many practical scenarios, a given worker may straggle over an extended period of time. We propose a latency model that captures this behavior and is substantiated by traces collected on Microsoft Azure, Amazon Web Services (AWS), and a small local cluster. Building on this model, we propose DSAG, a mixed synchronous-asynchronous iterative optimization method, based on the stochastic average gradient (SAG) method, that combines timely and stale results. We also propose a dynamic load-balancing strategy to further reduce the impact of straggling workers. We evaluate DSAG for principal component analysis, cast as a finite-sum optimization problem, of a large genomics dataset, and for logistic regression on a cluster composed of 100 workers on AWS, and find that DSAG is up to about 50% faster than SAG, and more than twice as fast as coded computing methods, for the particular scenario that we consider." @default.
- W4226285890 created "2022-05-05" @default.
- W4226285890 creator A5000735073 @default.
- W4226285890 creator A5014522913 @default.
- W4226285890 creator A5059817205 @default.
- W4226285890 creator A5090738616 @default.
- W4226285890 date "2021-11-27" @default.
- W4226285890 modified "2023-09-23" @default.
- W4226285890 title "DSAG: A mixed synchronous-asynchronous iterative method for straggler-resilient learning" @default.
- W4226285890 hasPublicationYear "2021" @default.
- W4226285890 type Work @default.
- W4226285890 citedByCount "0" @default.
- W4226285890 crossrefType "posted-content" @default.
- W4226285890 hasAuthorship W4226285890A5000735073 @default.
- W4226285890 hasAuthorship W4226285890A5014522913 @default.
- W4226285890 hasAuthorship W4226285890A5059817205 @default.
- W4226285890 hasAuthorship W4226285890A5090738616 @default.
- W4226285890 hasBestOaLocation W42262858901 @default.
- W4226285890 hasConcept C105795698 @default.
- W4226285890 hasConcept C120314980 @default.
- W4226285890 hasConcept C122123141 @default.
- W4226285890 hasConcept C126255220 @default.
- W4226285890 hasConcept C141513077 @default.
- W4226285890 hasConcept C151319957 @default.
- W4226285890 hasConcept C164866538 @default.
- W4226285890 hasConcept C31258907 @default.
- W4226285890 hasConcept C33923547 @default.
- W4226285890 hasConcept C41008148 @default.
- W4226285890 hasConcept C76155785 @default.
- W4226285890 hasConcept C82876162 @default.
- W4226285890 hasConceptScore W4226285890C105795698 @default.
- W4226285890 hasConceptScore W4226285890C120314980 @default.
- W4226285890 hasConceptScore W4226285890C122123141 @default.
- W4226285890 hasConceptScore W4226285890C126255220 @default.
- W4226285890 hasConceptScore W4226285890C141513077 @default.
- W4226285890 hasConceptScore W4226285890C151319957 @default.
- W4226285890 hasConceptScore W4226285890C164866538 @default.
- W4226285890 hasConceptScore W4226285890C31258907 @default.
- W4226285890 hasConceptScore W4226285890C33923547 @default.
- W4226285890 hasConceptScore W4226285890C41008148 @default.
- W4226285890 hasConceptScore W4226285890C76155785 @default.
- W4226285890 hasConceptScore W4226285890C82876162 @default.
- W4226285890 hasLocation W42262858901 @default.
- W4226285890 hasOpenAccess W4226285890 @default.
- W4226285890 hasPrimaryLocation W42262858901 @default.
- W4226285890 hasRelatedWork W1123049 @default.
- W4226285890 hasRelatedWork W12708014 @default.
- W4226285890 hasRelatedWork W245032 @default.
- W4226285890 hasRelatedWork W3046629 @default.
- W4226285890 hasRelatedWork W585590 @default.
- W4226285890 hasRelatedWork W8115628 @default.
- W4226285890 hasRelatedWork W8438639 @default.
- W4226285890 hasRelatedWork W893318 @default.
- W4226285890 hasRelatedWork W11733333 @default.
- W4226285890 hasRelatedWork W16129506 @default.
- W4226285890 isParatext "false" @default.
- W4226285890 isRetracted "false" @default.
- W4226285890 workType "article" @default.