Matches in SemOpenAlex for { <https://semopenalex.org/work/W4221138862> ?p ?o ?g. }
Showing items 1 to 74 of
74
with 100 items per page.
- W4221138862 abstract "Wall-clock convergence time and communication load are key performance metrics for the distributed implementation of stochastic gradient descent (SGD) in parameter server settings. Communication-adaptive distributed Adam (CADA) has been recently proposed as a way to reduce communication load via the adaptive selection of workers. CADA is subject to performance degradation in terms of wall-clock convergence time in the presence of stragglers. This paper proposes a novel scheme named grouping-based CADA (G-CADA) that retains the advantages of CADA in reducing the communication load, while increasing the robustness to stragglers at the cost of additional storage at the workers. G-CADA partitions the workers into groups of workers that are assigned the same data shards. Groups are scheduled adaptively at each iteration, and the server only waits for the fastest worker in each selected group. We provide analysis and experimental results to elaborate the significant gains on the wall-clock time, as well as communication load and computation load, of G-CADA over other benchmark schemes." @default.
- W4221138862 created "2022-04-03" @default.
- W4221138862 creator A5006822602 @default.
- W4221138862 creator A5017736224 @default.
- W4221138862 creator A5025299678 @default.
- W4221138862 creator A5032122445 @default.
- W4221138862 date "2022-06-26" @default.
- W4221138862 modified "2023-09-27" @default.
- W4221138862 title "Adaptive Worker Grouping for Communication-Efficient and Straggler-Tolerant Distributed SGD" @default.
- W4221138862 cites W114517082 @default.
- W4221138862 cites W2060393849 @default.
- W4221138862 cites W2138996412 @default.
- W4221138862 cites W2757498728 @default.
- W4221138862 cites W2798525132 @default.
- W4221138862 cites W2963687457 @default.
- W4221138862 cites W3023838981 @default.
- W4221138862 cites W4236536374 @default.
- W4221138862 doi "https://doi.org/10.1109/isit50566.2022.9834752" @default.
- W4221138862 hasPublicationYear "2022" @default.
- W4221138862 type Work @default.
- W4221138862 citedByCount "0" @default.
- W4221138862 crossrefType "proceedings-article" @default.
- W4221138862 hasAuthorship W4221138862A5006822602 @default.
- W4221138862 hasAuthorship W4221138862A5017736224 @default.
- W4221138862 hasAuthorship W4221138862A5025299678 @default.
- W4221138862 hasAuthorship W4221138862A5032122445 @default.
- W4221138862 hasBestOaLocation W42211388622 @default.
- W4221138862 hasConcept C104317684 @default.
- W4221138862 hasConcept C120314980 @default.
- W4221138862 hasConcept C13280743 @default.
- W4221138862 hasConcept C138959212 @default.
- W4221138862 hasConcept C185592680 @default.
- W4221138862 hasConcept C185798385 @default.
- W4221138862 hasConcept C187691185 @default.
- W4221138862 hasConcept C205649164 @default.
- W4221138862 hasConcept C2524010 @default.
- W4221138862 hasConcept C31258907 @default.
- W4221138862 hasConcept C33923547 @default.
- W4221138862 hasConcept C41008148 @default.
- W4221138862 hasConcept C55493867 @default.
- W4221138862 hasConcept C63479239 @default.
- W4221138862 hasConceptScore W4221138862C104317684 @default.
- W4221138862 hasConceptScore W4221138862C120314980 @default.
- W4221138862 hasConceptScore W4221138862C13280743 @default.
- W4221138862 hasConceptScore W4221138862C138959212 @default.
- W4221138862 hasConceptScore W4221138862C185592680 @default.
- W4221138862 hasConceptScore W4221138862C185798385 @default.
- W4221138862 hasConceptScore W4221138862C187691185 @default.
- W4221138862 hasConceptScore W4221138862C205649164 @default.
- W4221138862 hasConceptScore W4221138862C2524010 @default.
- W4221138862 hasConceptScore W4221138862C31258907 @default.
- W4221138862 hasConceptScore W4221138862C33923547 @default.
- W4221138862 hasConceptScore W4221138862C41008148 @default.
- W4221138862 hasConceptScore W4221138862C55493867 @default.
- W4221138862 hasConceptScore W4221138862C63479239 @default.
- W4221138862 hasFunder F4320321001 @default.
- W4221138862 hasFunder F4320334678 @default.
- W4221138862 hasLocation W42211388621 @default.
- W4221138862 hasLocation W42211388622 @default.
- W4221138862 hasOpenAccess W4221138862 @default.
- W4221138862 hasPrimaryLocation W42211388621 @default.
- W4221138862 hasRelatedWork W1496103710 @default.
- W4221138862 hasRelatedWork W163783926 @default.
- W4221138862 hasRelatedWork W2098672555 @default.
- W4221138862 hasRelatedWork W2150101281 @default.
- W4221138862 hasRelatedWork W2264247447 @default.
- W4221138862 hasRelatedWork W2354164008 @default.
- W4221138862 hasRelatedWork W2376924539 @default.
- W4221138862 hasRelatedWork W2380023786 @default.
- W4221138862 hasRelatedWork W2385899138 @default.
- W4221138862 hasRelatedWork W2998813341 @default.
- W4221138862 isParatext "false" @default.
- W4221138862 isRetracted "false" @default.
- W4221138862 workType "article" @default.