Matches in SemOpenAlex for { <https://semopenalex.org/work/W3204266910> ?p ?o ?g. }
- W3204266910 abstract "There has been a growing need to provide Byzantine-resilience in distributed model training. Existing robust distributed learning algorithms focus on developing sophisticated robust aggregators at the parameter servers, but pay less attention to balancing the communication cost and robustness. In this paper, we propose Solon, an algorithmic framework that exploits gradient redundancy to provide communication efficiency and Byzantine robustness simultaneously. Our theoretical analysis shows a fundamental trade-off among computational load, communication cost, and Byzantine robustness. We also develop a concrete algorithm to achieve the optimal trade-off, borrowing ideas from coding theory and sparse recovery. Empirical experiments on various datasets demonstrate that Solon provides significant speedups over existing methods to achieve the same accuracy, over 10 times faster than Bulyan and 80% faster than Draco. We also show that carefully designed Byzantine attacks break Signum and Bulyan, but do not affect the successful convergence of Solon." @default.
- W3204266910 created "2021-10-11" @default.
- W3204266910 creator A5003134390 @default.
- W3204266910 creator A5026685207 @default.
- W3204266910 creator A5031235093 @default.
- W3204266910 creator A5049494334 @default.
- W3204266910 creator A5081006850 @default.
- W3204266910 date "2021-10-04" @default.
- W3204266910 modified "2023-09-26" @default.
- W3204266910 title "Solon: Communication-efficient Byzantine-resilient Distributed Training via Redundant Gradients." @default.
- W3204266910 cites W1591116419 @default.
- W3204266910 cites W1686810756 @default.
- W3204266910 cites W1992409670 @default.
- W3204266910 cites W2059919683 @default.
- W3204266910 cites W2078204800 @default.
- W3204266910 cites W2083842231 @default.
- W3204266910 cites W2107438106 @default.
- W3204266910 cites W2108598243 @default.
- W3204266910 cites W2120510885 @default.
- W3204266910 cites W2127941149 @default.
- W3204266910 cites W2136939460 @default.
- W3204266910 cites W2151857680 @default.
- W3204266910 cites W2155195660 @default.
- W3204266910 cites W2156909104 @default.
- W3204266910 cites W2168231600 @default.
- W3204266910 cites W2194775991 @default.
- W3204266910 cites W2294690908 @default.
- W3204266910 cites W2335728318 @default.
- W3204266910 cites W2407022425 @default.
- W3204266910 cites W2525332836 @default.
- W3204266910 cites W2535838896 @default.
- W3204266910 cites W2541884796 @default.
- W3204266910 cites W2547352193 @default.
- W3204266910 cites W2614254310 @default.
- W3204266910 cites W2741736887 @default.
- W3204266910 cites W2752689052 @default.
- W3204266910 cites W2787998955 @default.
- W3204266910 cites W2890924858 @default.
- W3204266910 cites W2896457183 @default.
- W3204266910 cites W2908007030 @default.
- W3204266910 cites W2944844562 @default.
- W3204266910 cites W2946633206 @default.
- W3204266910 cites W2953498285 @default.
- W3204266910 cites W2963165390 @default.
- W3204266910 cites W2963803379 @default.
- W3204266910 cites W2964004663 @default.
- W3204266910 cites W2964160151 @default.
- W3204266910 cites W2964261056 @default.
- W3204266910 cites W2964267428 @default.
- W3204266910 cites W2966757932 @default.
- W3204266910 cites W2970204870 @default.
- W3204266910 cites W2970289928 @default.
- W3204266910 cites W2970349186 @default.
- W3204266910 cites W2970971581 @default.
- W3204266910 cites W3027670001 @default.
- W3204266910 cites W3046556863 @default.
- W3204266910 cites W3096004388 @default.
- W3204266910 cites W3096403968 @default.
- W3204266910 cites W3097490775 @default.
- W3204266910 cites W3114131478 @default.
- W3204266910 cites W3118608800 @default.
- W3204266910 cites W3150749950 @default.
- W3204266910 hasPublicationYear "2021" @default.
- W3204266910 type Work @default.
- W3204266910 sameAs 3204266910 @default.
- W3204266910 citedByCount "0" @default.
- W3204266910 crossrefType "posted-content" @default.
- W3204266910 hasAuthorship W3204266910A5003134390 @default.
- W3204266910 hasAuthorship W3204266910A5026685207 @default.
- W3204266910 hasAuthorship W3204266910A5031235093 @default.
- W3204266910 hasAuthorship W3204266910A5049494334 @default.
- W3204266910 hasAuthorship W3204266910A5081006850 @default.
- W3204266910 hasConcept C104317684 @default.
- W3204266910 hasConcept C104562893 @default.
- W3204266910 hasConcept C111919701 @default.
- W3204266910 hasConcept C120314980 @default.
- W3204266910 hasConcept C152124472 @default.
- W3204266910 hasConcept C165696696 @default.
- W3204266910 hasConcept C168021876 @default.
- W3204266910 hasConcept C17532199 @default.
- W3204266910 hasConcept C185592680 @default.
- W3204266910 hasConcept C195244886 @default.
- W3204266910 hasConcept C31258907 @default.
- W3204266910 hasConcept C38652104 @default.
- W3204266910 hasConcept C41008148 @default.
- W3204266910 hasConcept C55493867 @default.
- W3204266910 hasConcept C63479239 @default.
- W3204266910 hasConcept C63540848 @default.
- W3204266910 hasConcept C80444323 @default.
- W3204266910 hasConcept C93996380 @default.
- W3204266910 hasConcept C95457728 @default.
- W3204266910 hasConceptScore W3204266910C104317684 @default.
- W3204266910 hasConceptScore W3204266910C104562893 @default.
- W3204266910 hasConceptScore W3204266910C111919701 @default.
- W3204266910 hasConceptScore W3204266910C120314980 @default.
- W3204266910 hasConceptScore W3204266910C152124472 @default.
- W3204266910 hasConceptScore W3204266910C165696696 @default.
- W3204266910 hasConceptScore W3204266910C168021876 @default.
- W3204266910 hasConceptScore W3204266910C17532199 @default.
- W3204266910 hasConceptScore W3204266910C185592680 @default.