Matches in SemOpenAlex for { <https://semopenalex.org/work/W3128889203> ?p ?o ?g. }
Showing items 1 to 77 of
77
with 100 items per page.
- W3128889203 abstract "We study adversary-resilient stochastic distributed optimization, in which $m$ machines can independently compute stochastic gradients, and cooperate to jointly optimize over their local objective functions. However, an $alpha$-fraction of the machines are $textit{Byzantine}$, in that they may behave in arbitrary, adversarial ways. We consider a variant of this procedure in the challenging $textit{non-convex}$ case. Our main result is a new algorithm SafeguardSGD which can provably escape saddle points and find approximate local minima of the non-convex objective. The algorithm is based on a new concentration filtering technique, and its sample and time complexity bounds match the best known theoretical bounds in the stochastic, distributed setting when no Byzantine machines are present. Our algorithm is very practical: it improves upon the performance of all prior methods when training deep neural networks, it is relatively lightweight, and it is the first method to withstand two recently-proposed Byzantine attacks." @default.
- W3128889203 created "2021-02-15" @default.
- W3128889203 creator A5006277823 @default.
- W3128889203 creator A5048981295 @default.
- W3128889203 creator A5054631254 @default.
- W3128889203 creator A5083822059 @default.
- W3128889203 date "2020-12-28" @default.
- W3128889203 modified "2023-09-26" @default.
- W3128889203 title "Byzantine-Resilient Non-Convex Stochastic Gradient Descent" @default.
- W3128889203 doi "https://doi.org/10.48550/arxiv.2012.14368" @default.
- W3128889203 hasPublicationYear "2020" @default.
- W3128889203 type Work @default.
- W3128889203 sameAs 3128889203 @default.
- W3128889203 citedByCount "5" @default.
- W3128889203 countsByYear W31288892032020 @default.
- W3128889203 countsByYear W31288892032021 @default.
- W3128889203 crossrefType "posted-content" @default.
- W3128889203 hasAuthorship W3128889203A5006277823 @default.
- W3128889203 hasAuthorship W3128889203A5048981295 @default.
- W3128889203 hasAuthorship W3128889203A5054631254 @default.
- W3128889203 hasAuthorship W3128889203A5083822059 @default.
- W3128889203 hasBestOaLocation W31288892031 @default.
- W3128889203 hasConcept C104562893 @default.
- W3128889203 hasConcept C112680207 @default.
- W3128889203 hasConcept C11413529 @default.
- W3128889203 hasConcept C126255220 @default.
- W3128889203 hasConcept C134306372 @default.
- W3128889203 hasConcept C149629883 @default.
- W3128889203 hasConcept C154945302 @default.
- W3128889203 hasConcept C178790620 @default.
- W3128889203 hasConcept C185592680 @default.
- W3128889203 hasConcept C186633575 @default.
- W3128889203 hasConcept C195244886 @default.
- W3128889203 hasConcept C206688291 @default.
- W3128889203 hasConcept C2524010 @default.
- W3128889203 hasConcept C2681867 @default.
- W3128889203 hasConcept C2984842247 @default.
- W3128889203 hasConcept C33923547 @default.
- W3128889203 hasConcept C41008148 @default.
- W3128889203 hasConcept C50644808 @default.
- W3128889203 hasConcept C95457728 @default.
- W3128889203 hasConceptScore W3128889203C104562893 @default.
- W3128889203 hasConceptScore W3128889203C112680207 @default.
- W3128889203 hasConceptScore W3128889203C11413529 @default.
- W3128889203 hasConceptScore W3128889203C126255220 @default.
- W3128889203 hasConceptScore W3128889203C134306372 @default.
- W3128889203 hasConceptScore W3128889203C149629883 @default.
- W3128889203 hasConceptScore W3128889203C154945302 @default.
- W3128889203 hasConceptScore W3128889203C178790620 @default.
- W3128889203 hasConceptScore W3128889203C185592680 @default.
- W3128889203 hasConceptScore W3128889203C186633575 @default.
- W3128889203 hasConceptScore W3128889203C195244886 @default.
- W3128889203 hasConceptScore W3128889203C206688291 @default.
- W3128889203 hasConceptScore W3128889203C2524010 @default.
- W3128889203 hasConceptScore W3128889203C2681867 @default.
- W3128889203 hasConceptScore W3128889203C2984842247 @default.
- W3128889203 hasConceptScore W3128889203C33923547 @default.
- W3128889203 hasConceptScore W3128889203C41008148 @default.
- W3128889203 hasConceptScore W3128889203C50644808 @default.
- W3128889203 hasConceptScore W3128889203C95457728 @default.
- W3128889203 hasLocation W31288892031 @default.
- W3128889203 hasOpenAccess W3128889203 @default.
- W3128889203 hasPrimaryLocation W31288892031 @default.
- W3128889203 hasRelatedWork W2012667922 @default.
- W3128889203 hasRelatedWork W2364230301 @default.
- W3128889203 hasRelatedWork W2788923859 @default.
- W3128889203 hasRelatedWork W2963317585 @default.
- W3128889203 hasRelatedWork W3048505912 @default.
- W3128889203 hasRelatedWork W3115472659 @default.
- W3128889203 hasRelatedWork W3128889203 @default.
- W3128889203 hasRelatedWork W3186933740 @default.
- W3128889203 hasRelatedWork W4221163907 @default.
- W3128889203 hasRelatedWork W4287828901 @default.
- W3128889203 isParatext "false" @default.
- W3128889203 isRetracted "false" @default.
- W3128889203 magId "3128889203" @default.
- W3128889203 workType "article" @default.