Matches in SemOpenAlex for { <https://semopenalex.org/work/W3125943371> ?p ?o ?g. }
- W3125943371 abstract "Coded computation can speed up distributed learning in the presence of straggling workers. Partial recovery of the gradient vector can further reduce the computation time at each iteration; however, this can result in biased estimators, which may slow down convergence, or even cause divergence. Estimator bias is particularly prevalent when the straggling behavior is correlated over time, which results in the gradient estimators being dominated by a few fast servers. To mitigate biased estimators, we design a timely dynamic encoding framework for partial recovery that includes an ordering operator that changes the codewords and computation orders at workers over time. To regulate the recovery frequencies, we adopt an age metric in the design of the dynamic encoding scheme. The proposed age-based scheme prioritizes the recovery of computations with relatively large age. We show through numerical results that the proposed dynamic encoding strategy increases the timeliness of the recovered computations, which, as a result, reduces the bias in model updates, and accelerates the convergence compared to conventional static partial recovery schemes." @default.
- W3125943371 created "2021-02-01" @default.
- W3125943371 creator A5009592121 @default.
- W3125943371 creator A5016883501 @default.
- W3125943371 creator A5021132487 @default.
- W3125943371 creator A5056993728 @default.
- W3125943371 date "2020-12-01" @default.
- W3125943371 modified "2023-10-17" @default.
- W3125943371 title "Age-Based Coded Computation for Bias Reduction in Distributed Learning" @default.
- W3125943371 cites W1993918491 @default.
- W3125943371 cites W2060393849 @default.
- W3125943371 cites W2268702383 @default.
- W3125943371 cites W2901745114 @default.
- W3125943371 cites W2938913720 @default.
- W3125943371 cites W2962813697 @default.
- W3125943371 cites W2963062115 @default.
- W3125943371 cites W2963117124 @default.
- W3125943371 cites W2963687457 @default.
- W3125943371 cites W2963706835 @default.
- W3125943371 cites W2964120628 @default.
- W3125943371 cites W2964229375 @default.
- W3125943371 cites W2975971390 @default.
- W3125943371 cites W2976175943 @default.
- W3125943371 cites W2976668007 @default.
- W3125943371 cites W2976713597 @default.
- W3125943371 cites W3013804650 @default.
- W3125943371 cites W3015418122 @default.
- W3125943371 cites W3015574552 @default.
- W3125943371 cites W3015733297 @default.
- W3125943371 cites W3023838981 @default.
- W3125943371 cites W4211024811 @default.
- W3125943371 cites W4249253882 @default.
- W3125943371 doi "https://doi.org/10.1109/globecom42002.2020.9322412" @default.
- W3125943371 hasPublicationYear "2020" @default.
- W3125943371 type Work @default.
- W3125943371 sameAs 3125943371 @default.
- W3125943371 citedByCount "16" @default.
- W3125943371 countsByYear W31259433712020 @default.
- W3125943371 countsByYear W31259433712021 @default.
- W3125943371 countsByYear W31259433712022 @default.
- W3125943371 countsByYear W31259433712023 @default.
- W3125943371 crossrefType "proceedings-article" @default.
- W3125943371 hasAuthorship W3125943371A5009592121 @default.
- W3125943371 hasAuthorship W3125943371A5016883501 @default.
- W3125943371 hasAuthorship W3125943371A5021132487 @default.
- W3125943371 hasAuthorship W3125943371A5056993728 @default.
- W3125943371 hasBestOaLocation W31259433712 @default.
- W3125943371 hasConcept C105795698 @default.
- W3125943371 hasConcept C111335779 @default.
- W3125943371 hasConcept C11413529 @default.
- W3125943371 hasConcept C125411270 @default.
- W3125943371 hasConcept C126255220 @default.
- W3125943371 hasConcept C136764020 @default.
- W3125943371 hasConcept C138885662 @default.
- W3125943371 hasConcept C154945302 @default.
- W3125943371 hasConcept C162307627 @default.
- W3125943371 hasConcept C162324750 @default.
- W3125943371 hasConcept C176217482 @default.
- W3125943371 hasConcept C185429906 @default.
- W3125943371 hasConcept C207390915 @default.
- W3125943371 hasConcept C21547014 @default.
- W3125943371 hasConcept C2524010 @default.
- W3125943371 hasConcept C2777303404 @default.
- W3125943371 hasConcept C2778456923 @default.
- W3125943371 hasConcept C2781041963 @default.
- W3125943371 hasConcept C33923547 @default.
- W3125943371 hasConcept C41008148 @default.
- W3125943371 hasConcept C41895202 @default.
- W3125943371 hasConcept C45374587 @default.
- W3125943371 hasConcept C50522688 @default.
- W3125943371 hasConcept C93996380 @default.
- W3125943371 hasConceptScore W3125943371C105795698 @default.
- W3125943371 hasConceptScore W3125943371C111335779 @default.
- W3125943371 hasConceptScore W3125943371C11413529 @default.
- W3125943371 hasConceptScore W3125943371C125411270 @default.
- W3125943371 hasConceptScore W3125943371C126255220 @default.
- W3125943371 hasConceptScore W3125943371C136764020 @default.
- W3125943371 hasConceptScore W3125943371C138885662 @default.
- W3125943371 hasConceptScore W3125943371C154945302 @default.
- W3125943371 hasConceptScore W3125943371C162307627 @default.
- W3125943371 hasConceptScore W3125943371C162324750 @default.
- W3125943371 hasConceptScore W3125943371C176217482 @default.
- W3125943371 hasConceptScore W3125943371C185429906 @default.
- W3125943371 hasConceptScore W3125943371C207390915 @default.
- W3125943371 hasConceptScore W3125943371C21547014 @default.
- W3125943371 hasConceptScore W3125943371C2524010 @default.
- W3125943371 hasConceptScore W3125943371C2777303404 @default.
- W3125943371 hasConceptScore W3125943371C2778456923 @default.
- W3125943371 hasConceptScore W3125943371C2781041963 @default.
- W3125943371 hasConceptScore W3125943371C33923547 @default.
- W3125943371 hasConceptScore W3125943371C41008148 @default.
- W3125943371 hasConceptScore W3125943371C41895202 @default.
- W3125943371 hasConceptScore W3125943371C45374587 @default.
- W3125943371 hasConceptScore W3125943371C50522688 @default.
- W3125943371 hasConceptScore W3125943371C93996380 @default.
- W3125943371 hasFunder F4320334678 @default.
- W3125943371 hasLocation W31259433711 @default.
- W3125943371 hasLocation W31259433712 @default.
- W3125943371 hasOpenAccess W3125943371 @default.
- W3125943371 hasPrimaryLocation W31259433711 @default.