Matches in SemOpenAlex for { <https://semopenalex.org/work/W4385774723> ?p ?o ?g. }
Showing items 1 to 69 of
69
with 100 items per page.
- W4385774723 abstract "This paper studies Byzantine-robust stochastic optimization over a decentralized network, where every agent periodically communicates with its neighbors to exchange local models, and then updates its own local model by stochastic gradient descent (SGD). The performance of such a method is affected by an unknown number of Byzantine agents, which conduct adversarially during the optimization process. To the best of our knowledge, there is no existing work that simultaneously achieves a linear convergence speed and a small learning error. We observe that the learning error is largely dependent on the intrinsic stochastic gradient noise. Motivated by this observation, we introduce two variance reduction methods, stochastic average gradient algorithm (SAGA) and loopless stochastic variance-reduced gradient (LSVRG), to Byzantine-robust decentralized stochastic optimization for eliminating the negative effect of the stochastic gradient noise. The two resulting methods, BRAVO-SAGA and BRAVO-LSVRG, enjoy both linear convergence speeds and stochastic gradient noise-independent learning errors. Such learning errors are optimal for a class of methods based on total variation (TV)-norm regularization and stochastic subgradient update. We conduct extensive numerical experiments to demonstrate their effectiveness under various Byzantine attacks." @default.
- W4385774723 created "2023-08-12" @default.
- W4385774723 creator A5029820392 @default.
- W4385774723 creator A5032223248 @default.
- W4385774723 creator A5069953599 @default.
- W4385774723 date "2023-08-09" @default.
- W4385774723 modified "2023-09-27" @default.
- W4385774723 title "Byzantine-Robust Decentralized Stochastic Optimization with Stochastic Gradient Noise-Independent Learning Error" @default.
- W4385774723 doi "https://doi.org/10.48550/arxiv.2308.05292" @default.
- W4385774723 hasPublicationYear "2023" @default.
- W4385774723 type Work @default.
- W4385774723 citedByCount "0" @default.
- W4385774723 crossrefType "posted-content" @default.
- W4385774723 hasAuthorship W4385774723A5029820392 @default.
- W4385774723 hasAuthorship W4385774723A5032223248 @default.
- W4385774723 hasAuthorship W4385774723A5069953599 @default.
- W4385774723 hasBestOaLocation W43857747231 @default.
- W4385774723 hasConcept C105795698 @default.
- W4385774723 hasConcept C115961682 @default.
- W4385774723 hasConcept C126255220 @default.
- W4385774723 hasConcept C153258448 @default.
- W4385774723 hasConcept C154945302 @default.
- W4385774723 hasConcept C158968445 @default.
- W4385774723 hasConcept C162324750 @default.
- W4385774723 hasConcept C194387892 @default.
- W4385774723 hasConcept C19499675 @default.
- W4385774723 hasConcept C206688291 @default.
- W4385774723 hasConcept C2776135515 @default.
- W4385774723 hasConcept C2777303404 @default.
- W4385774723 hasConcept C33923547 @default.
- W4385774723 hasConcept C41008148 @default.
- W4385774723 hasConcept C50522688 @default.
- W4385774723 hasConcept C50644808 @default.
- W4385774723 hasConcept C62644790 @default.
- W4385774723 hasConcept C99498987 @default.
- W4385774723 hasConceptScore W4385774723C105795698 @default.
- W4385774723 hasConceptScore W4385774723C115961682 @default.
- W4385774723 hasConceptScore W4385774723C126255220 @default.
- W4385774723 hasConceptScore W4385774723C153258448 @default.
- W4385774723 hasConceptScore W4385774723C154945302 @default.
- W4385774723 hasConceptScore W4385774723C158968445 @default.
- W4385774723 hasConceptScore W4385774723C162324750 @default.
- W4385774723 hasConceptScore W4385774723C194387892 @default.
- W4385774723 hasConceptScore W4385774723C19499675 @default.
- W4385774723 hasConceptScore W4385774723C206688291 @default.
- W4385774723 hasConceptScore W4385774723C2776135515 @default.
- W4385774723 hasConceptScore W4385774723C2777303404 @default.
- W4385774723 hasConceptScore W4385774723C33923547 @default.
- W4385774723 hasConceptScore W4385774723C41008148 @default.
- W4385774723 hasConceptScore W4385774723C50522688 @default.
- W4385774723 hasConceptScore W4385774723C50644808 @default.
- W4385774723 hasConceptScore W4385774723C62644790 @default.
- W4385774723 hasConceptScore W4385774723C99498987 @default.
- W4385774723 hasLocation W43857747231 @default.
- W4385774723 hasOpenAccess W4385774723 @default.
- W4385774723 hasPrimaryLocation W43857747231 @default.
- W4385774723 hasRelatedWork W2055039565 @default.
- W4385774723 hasRelatedWork W2107438106 @default.
- W4385774723 hasRelatedWork W2303021954 @default.
- W4385774723 hasRelatedWork W2898416980 @default.
- W4385774723 hasRelatedWork W3045679877 @default.
- W4385774723 hasRelatedWork W3102816259 @default.
- W4385774723 hasRelatedWork W4308823743 @default.
- W4385774723 hasRelatedWork W4385452083 @default.
- W4385774723 hasRelatedWork W4385774723 @default.
- W4385774723 hasRelatedWork W2012437081 @default.
- W4385774723 isParatext "false" @default.
- W4385774723 isRetracted "false" @default.
- W4385774723 workType "article" @default.