FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3048657726> ?p ?o ?g. }

• W3048657726 abstract "This paper considers the Byzantine fault-tolerance problem in distributed stochastic gradient descent (D-SGD) method - a popular algorithm for distributed multi-agent machine learning. In this problem, each agent samples data points independently from a certain data-generating distribution. In the fault-free case, the D-SGD method allows all the agents to learn a mathematical model best fitting the data collectively sampled by all agents. We consider the case when a fraction of agents may be Byzantine faulty. Such faulty agents may not follow a prescribed algorithm correctly, and may render traditional D-SGD method ineffective by sharing arbitrary incorrect stochastic gradients. We propose a norm-based gradient-filter, named comparative gradient elimination (CGE), that robustifies the D-SGD method against Byzantine agents. We show that the CGE gradient-filter guarantees fault-tolerance against a bounded fraction of Byzantine agents under standard stochastic assumptions, and is computationally simpler compared to many existing gradient-filters such as multi-KRUM, geometric median-of-means, and the spectral filters. We empirically show, by simulating distributed learning on neural networks, that the fault-tolerance of CGE is comparable to that of existing gradient-filters. We also empirically show that exponential averaging of stochastic gradients improves the fault-tolerance of a generic gradient-filter." @default.
• W3048657726 created "2020-08-18" @default.
• W3048657726 creator A5042521435 @default.
• W3048657726 creator A5054849639 @default.
• W3048657726 creator A5072709319 @default.
• W3048657726 date "2020-08-11" @default.
• W3048657726 modified "2023-09-27" @default.
• W3048657726 title "Byzantine Fault-Tolerant Distributed Machine Learning Using Stochastic Gradient Descent (SGD) and Norm-Based Comparative Gradient Elimination (CGE)." @default.
• W3048657726 cites W2001032894 @default.
• W3048657726 cites W2010828064 @default.
• W3048657726 cites W2044212084 @default.
• W3048657726 cites W2053637704 @default.
• W3048657726 cites W2110959113 @default.
• W3048657726 cites W2132211083 @default.
• W3048657726 cites W2164278908 @default.
• W3048657726 cites W2402302915 @default.
• W3048657726 cites W2490498838 @default.
• W3048657726 cites W2554864439 @default.
• W3048657726 cites W2614254310 @default.
• W3048657726 cites W2752689052 @default.
• W3048657726 cites W2896689993 @default.
• W3048657726 cites W2908007030 @default.
• W3048657726 cites W2912213068 @default.
• W3048657726 cites W2923191059 @default.
• W3048657726 cites W2962775700 @default.
• W3048657726 cites W2963165390 @default.
• W3048657726 cites W2963300197 @default.
• W3048657726 cites W2963334472 @default.
• W3048657726 cites W2963433607 @default.
• W3048657726 cites W2963888996 @default.
• W3048657726 cites W2964135521 @default.
• W3048657726 cites W2964275427 @default.
• W3048657726 cites W2970349186 @default.
• W3048657726 cites W2970971581 @default.
• W3048657726 cites W3017335724 @default.
• W3048657726 cites W3025254786 @default.
• W3048657726 cites W3034600652 @default.
• W3048657726 cites W3041980573 @default.
• W3048657726 cites W3046561551 @default.
• W3048657726 cites W3101352448 @default.
• W3048657726 cites W3121577626 @default.
• W3048657726 cites W3137092842 @default.
• W3048657726 hasPublicationYear "2020" @default.
• W3048657726 type Work @default.
• W3048657726 sameAs 3048657726 @default.
• W3048657726 citedByCount "5" @default.
• W3048657726 countsByYear W30486577262020 @default.
• W3048657726 countsByYear W30486577262021 @default.
• W3048657726 crossrefType "posted-content" @default.
• W3048657726 hasAuthorship W3048657726A5042521435 @default.
• W3048657726 hasAuthorship W3048657726A5054849639 @default.
• W3048657726 hasAuthorship W3048657726A5072709319 @default.
• W3048657726 hasConcept C106131492 @default.
• W3048657726 hasConcept C11413529 @default.
• W3048657726 hasConcept C120314980 @default.
• W3048657726 hasConcept C126255220 @default.
• W3048657726 hasConcept C134306372 @default.
• W3048657726 hasConcept C153258448 @default.
• W3048657726 hasConcept C154945302 @default.
• W3048657726 hasConcept C168021876 @default.
• W3048657726 hasConcept C17744445 @default.
• W3048657726 hasConcept C191795146 @default.
• W3048657726 hasConcept C199539241 @default.
• W3048657726 hasConcept C206688291 @default.
• W3048657726 hasConcept C31972630 @default.
• W3048657726 hasConcept C33923547 @default.
• W3048657726 hasConcept C34388435 @default.
• W3048657726 hasConcept C41008148 @default.
• W3048657726 hasConcept C50644808 @default.
• W3048657726 hasConcept C63540848 @default.
• W3048657726 hasConceptScore W3048657726C106131492 @default.
• W3048657726 hasConceptScore W3048657726C11413529 @default.
• W3048657726 hasConceptScore W3048657726C120314980 @default.
• W3048657726 hasConceptScore W3048657726C126255220 @default.
• W3048657726 hasConceptScore W3048657726C134306372 @default.
• W3048657726 hasConceptScore W3048657726C153258448 @default.
• W3048657726 hasConceptScore W3048657726C154945302 @default.
• W3048657726 hasConceptScore W3048657726C168021876 @default.
• W3048657726 hasConceptScore W3048657726C17744445 @default.
• W3048657726 hasConceptScore W3048657726C191795146 @default.
• W3048657726 hasConceptScore W3048657726C199539241 @default.
• W3048657726 hasConceptScore W3048657726C206688291 @default.
• W3048657726 hasConceptScore W3048657726C31972630 @default.
• W3048657726 hasConceptScore W3048657726C33923547 @default.
• W3048657726 hasConceptScore W3048657726C34388435 @default.
• W3048657726 hasConceptScore W3048657726C41008148 @default.
• W3048657726 hasConceptScore W3048657726C50644808 @default.
• W3048657726 hasConceptScore W3048657726C63540848 @default.
• W3048657726 hasLocation W30486577261 @default.
• W3048657726 hasOpenAccess W3048657726 @default.
• W3048657726 hasPrimaryLocation W30486577261 @default.
• W3048657726 hasRelatedWork W2193091921 @default.
• W3048657726 hasRelatedWork W2264980173 @default.
• W3048657726 hasRelatedWork W2554864439 @default.
• W3048657726 hasRelatedWork W2614254310 @default.
• W3048657726 hasRelatedWork W2752689052 @default.
• W3048657726 hasRelatedWork W2794969685 @default.
• W3048657726 hasRelatedWork W2918866497 @default.
• W3048657726 hasRelatedWork W2999590826 @default.
• W3048657726 hasRelatedWork W3012255161 @default.

• next