Matches in SemOpenAlex for { <https://semopenalex.org/work/W3205066395> ?p ?o ?g. }
- W3205066395 abstract "Privacy and Byzantine resilience (BR) are two crucial requirements of modern-day distributed machine learning. The two concepts have been extensively studied individually but the question of how to combine them effectively remains unanswered. This paper contributes to addressing this question by studying the extent to which the distributed SGD algorithm, in the standard parameter-server architecture, can learn an accurate model despite (a) a fraction of the workers being malicious (Byzantine), and (b) the other fraction, whilst being honest, providing noisy information to the server to ensure differential privacy (DP). We first observe that the integration of standard practices in DP and BR is not straightforward. In fact, we show that many existing results on the convergence of distributed SGD under Byzantine faults, especially those relying on $(alpha,f)$-Byzantine resilience, are rendered invalid when honest workers enforce DP. To circumvent this shortcoming, we revisit the theory of $(alpha,f)$-BR to obtain an approximate convergence guarantee. Our analysis provides key insights on how to improve this guarantee through hyperparameter optimization. Essentially, our theoretical and empirical results show that (1) an imprudent combination of standard approaches to DP and BR might be fruitless, but (2) by carefully re-tuning the learning algorithm, we can obtain reasonable learning accuracy while simultaneously guaranteeing DP and BR." @default.
- W3205066395 created "2021-10-25" @default.
- W3205066395 creator A5033087851 @default.
- W3205066395 creator A5045845689 @default.
- W3205066395 creator A5049321288 @default.
- W3205066395 creator A5054849639 @default.
- W3205066395 creator A5082964481 @default.
- W3205066395 date "2021-10-08" @default.
- W3205066395 modified "2023-09-27" @default.
- W3205066395 title "Combining Differential Privacy and Byzantine Resilience in Distributed SGD." @default.
- W3205066395 cites W1026270304 @default.
- W3205066395 cites W114517082 @default.
- W3205066395 cites W1985511977 @default.
- W3205066395 cites W1992926795 @default.
- W3205066395 cites W2027595342 @default.
- W3205066395 cites W2138865266 @default.
- W3205066395 cites W2168231600 @default.
- W3205066395 cites W2337093093 @default.
- W3205066395 cites W2473418344 @default.
- W3205066395 cites W2621140322 @default.
- W3205066395 cites W2750384547 @default.
- W3205066395 cites W2752689052 @default.
- W3205066395 cites W2788308444 @default.
- W3205066395 cites W2804948787 @default.
- W3205066395 cites W2914212774 @default.
- W3205066395 cites W2914861167 @default.
- W3205066395 cites W2936154336 @default.
- W3205066395 cites W2963165390 @default.
- W3205066395 cites W2963433607 @default.
- W3205066395 cites W2963612912 @default.
- W3205066395 cites W2963924077 @default.
- W3205066395 cites W2963952467 @default.
- W3205066395 cites W2964279249 @default.
- W3205066395 cites W2965721472 @default.
- W3205066395 cites W2966757932 @default.
- W3205066395 cites W2970204870 @default.
- W3205066395 cites W2973232880 @default.
- W3205066395 cites W2990595670 @default.
- W3205066395 cites W3043300996 @default.
- W3205066395 cites W3046556863 @default.
- W3205066395 cites W3084415909 @default.
- W3205066395 cites W3104224589 @default.
- W3205066395 cites W3106047871 @default.
- W3205066395 cites W3127421695 @default.
- W3205066395 cites W3132073757 @default.
- W3205066395 cites W3137092842 @default.
- W3205066395 cites W3175914740 @default.
- W3205066395 cites W3183165740 @default.
- W3205066395 hasPublicationYear "2021" @default.
- W3205066395 type Work @default.
- W3205066395 sameAs 3205066395 @default.
- W3205066395 citedByCount "0" @default.
- W3205066395 crossrefType "posted-content" @default.
- W3205066395 hasAuthorship W3205066395A5033087851 @default.
- W3205066395 hasAuthorship W3205066395A5045845689 @default.
- W3205066395 hasAuthorship W3205066395A5049321288 @default.
- W3205066395 hasAuthorship W3205066395A5054849639 @default.
- W3205066395 hasAuthorship W3205066395A5082964481 @default.
- W3205066395 hasConcept C104562893 @default.
- W3205066395 hasConcept C11413529 @default.
- W3205066395 hasConcept C119857082 @default.
- W3205066395 hasConcept C120314980 @default.
- W3205066395 hasConcept C121332964 @default.
- W3205066395 hasConcept C149629883 @default.
- W3205066395 hasConcept C154945302 @default.
- W3205066395 hasConcept C15744967 @default.
- W3205066395 hasConcept C162324750 @default.
- W3205066395 hasConcept C168021876 @default.
- W3205066395 hasConcept C17532199 @default.
- W3205066395 hasConcept C178790620 @default.
- W3205066395 hasConcept C185592680 @default.
- W3205066395 hasConcept C19417346 @default.
- W3205066395 hasConcept C195244886 @default.
- W3205066395 hasConcept C23130292 @default.
- W3205066395 hasConcept C26517878 @default.
- W3205066395 hasConcept C2777303404 @default.
- W3205066395 hasConcept C2779582901 @default.
- W3205066395 hasConcept C2779585090 @default.
- W3205066395 hasConcept C38652104 @default.
- W3205066395 hasConcept C41008148 @default.
- W3205066395 hasConcept C50522688 @default.
- W3205066395 hasConcept C63540848 @default.
- W3205066395 hasConcept C80444323 @default.
- W3205066395 hasConcept C8642999 @default.
- W3205066395 hasConcept C95457728 @default.
- W3205066395 hasConcept C97355855 @default.
- W3205066395 hasConceptScore W3205066395C104562893 @default.
- W3205066395 hasConceptScore W3205066395C11413529 @default.
- W3205066395 hasConceptScore W3205066395C119857082 @default.
- W3205066395 hasConceptScore W3205066395C120314980 @default.
- W3205066395 hasConceptScore W3205066395C121332964 @default.
- W3205066395 hasConceptScore W3205066395C149629883 @default.
- W3205066395 hasConceptScore W3205066395C154945302 @default.
- W3205066395 hasConceptScore W3205066395C15744967 @default.
- W3205066395 hasConceptScore W3205066395C162324750 @default.
- W3205066395 hasConceptScore W3205066395C168021876 @default.
- W3205066395 hasConceptScore W3205066395C17532199 @default.
- W3205066395 hasConceptScore W3205066395C178790620 @default.
- W3205066395 hasConceptScore W3205066395C185592680 @default.
- W3205066395 hasConceptScore W3205066395C19417346 @default.