Matches in SemOpenAlex for { <https://semopenalex.org/work/W3034510509> ?p ?o ?g. }
- W3034510509 abstract "We develop a distributed second order optimization algorithm that is communication-efficient as well as robust against Byzantine failures of the worker machines. We propose COMRADE (COMunication-efficient and Robust Approximate Distributed nEwton), an iterative second order algorithm, where the worker machines communicate only once per iteration with the center machine. This is in sharp contrast with the state-of-the-art distributed second order algorithms like GIANT [34] and DINGO[7], where the worker machines send (functions of) local gradient and Hessian sequentially; thus ending up communicating twice with the center machine per iteration. Moreover, we show that the worker machines can further compress the local information before sending it to the center. In addition, we employ a simple norm based thresholding rule to filter-out the Byzantine worker machines. We establish the linear-quadratic rate of convergence of COMRADE and establish that the communication savings and Byzantine resilience result in only a small statistical error rate for arbitrary convex loss functions. To the best of our knowledge, this is the first work that addresses the issue of Byzantine resilience in second order distributed optimization. Furthermore, we validate our theoretical results with extensive experiments on synthetic and benchmark LIBSVM [5] data-sets and demonstrate convergence guarantees." @default.
- W3034510509 created "2020-06-19" @default.
- W3034510509 creator A5032924598 @default.
- W3034510509 creator A5051046818 @default.
- W3034510509 creator A5083450236 @default.
- W3034510509 date "2020-06-15" @default.
- W3034510509 modified "2023-09-26" @default.
- W3034510509 title "Distributed Newton Can Communicate Less and Resist Byzantine Workers" @default.
- W3034510509 cites W1697545848 @default.
- W3034510509 cites W1855339086 @default.
- W3034510509 cites W1999352252 @default.
- W3034510509 cites W2153635508 @default.
- W3034510509 cites W2394933259 @default.
- W3034510509 cites W2490498838 @default.
- W3034510509 cites W2510078447 @default.
- W3034510509 cites W2530417694 @default.
- W3034510509 cites W2547352193 @default.
- W3034510509 cites W2593047802 @default.
- W3034510509 cites W2614254310 @default.
- W3034510509 cites W2616345629 @default.
- W3034510509 cites W2769644379 @default.
- W3034510509 cites W2788816110 @default.
- W3034510509 cites W2890924858 @default.
- W3034510509 cites W2892943996 @default.
- W3034510509 cites W2897474720 @default.
- W3034510509 cites W2924210329 @default.
- W3034510509 cites W2944844562 @default.
- W3034510509 cites W2947648688 @default.
- W3034510509 cites W2949270253 @default.
- W3034510509 cites W2949505878 @default.
- W3034510509 cites W2950826569 @default.
- W3034510509 cites W2963060476 @default.
- W3034510509 cites W2963335515 @default.
- W3034510509 cites W2963341956 @default.
- W3034510509 cites W2963495269 @default.
- W3034510509 cites W2963664311 @default.
- W3034510509 cites W2963992805 @default.
- W3034510509 cites W2964004663 @default.
- W3034510509 cites W2964267428 @default.
- W3034510509 cites W2964279249 @default.
- W3034510509 cites W2970236190 @default.
- W3034510509 cites W2989764977 @default.
- W3034510509 cites W2989787172 @default.
- W3034510509 cites W3080812040 @default.
- W3034510509 cites W3137092842 @default.
- W3034510509 hasPublicationYear "2020" @default.
- W3034510509 type Work @default.
- W3034510509 sameAs 3034510509 @default.
- W3034510509 citedByCount "4" @default.
- W3034510509 countsByYear W30345105092020 @default.
- W3034510509 countsByYear W30345105092021 @default.
- W3034510509 crossrefType "posted-content" @default.
- W3034510509 hasAuthorship W3034510509A5032924598 @default.
- W3034510509 hasAuthorship W3034510509A5051046818 @default.
- W3034510509 hasAuthorship W3034510509A5083450236 @default.
- W3034510509 hasConcept C11413529 @default.
- W3034510509 hasConcept C120314980 @default.
- W3034510509 hasConcept C126255220 @default.
- W3034510509 hasConcept C130120984 @default.
- W3034510509 hasConcept C13280743 @default.
- W3034510509 hasConcept C162324750 @default.
- W3034510509 hasConcept C185798385 @default.
- W3034510509 hasConcept C203616005 @default.
- W3034510509 hasConcept C205649164 @default.
- W3034510509 hasConcept C26517878 @default.
- W3034510509 hasConcept C2777303404 @default.
- W3034510509 hasConcept C28826006 @default.
- W3034510509 hasConcept C33923547 @default.
- W3034510509 hasConcept C38652104 @default.
- W3034510509 hasConcept C41008148 @default.
- W3034510509 hasConcept C50522688 @default.
- W3034510509 hasConcept C57869625 @default.
- W3034510509 hasConceptScore W3034510509C11413529 @default.
- W3034510509 hasConceptScore W3034510509C120314980 @default.
- W3034510509 hasConceptScore W3034510509C126255220 @default.
- W3034510509 hasConceptScore W3034510509C130120984 @default.
- W3034510509 hasConceptScore W3034510509C13280743 @default.
- W3034510509 hasConceptScore W3034510509C162324750 @default.
- W3034510509 hasConceptScore W3034510509C185798385 @default.
- W3034510509 hasConceptScore W3034510509C203616005 @default.
- W3034510509 hasConceptScore W3034510509C205649164 @default.
- W3034510509 hasConceptScore W3034510509C26517878 @default.
- W3034510509 hasConceptScore W3034510509C2777303404 @default.
- W3034510509 hasConceptScore W3034510509C28826006 @default.
- W3034510509 hasConceptScore W3034510509C33923547 @default.
- W3034510509 hasConceptScore W3034510509C38652104 @default.
- W3034510509 hasConceptScore W3034510509C41008148 @default.
- W3034510509 hasConceptScore W3034510509C50522688 @default.
- W3034510509 hasConceptScore W3034510509C57869625 @default.
- W3034510509 hasLocation W30345105091 @default.
- W3034510509 hasOpenAccess W3034510509 @default.
- W3034510509 hasPrimaryLocation W30345105091 @default.
- W3034510509 hasRelatedWork W1755985846 @default.
- W3034510509 hasRelatedWork W2132351238 @default.
- W3034510509 hasRelatedWork W2593047802 @default.
- W3034510509 hasRelatedWork W2788543015 @default.
- W3034510509 hasRelatedWork W2797573937 @default.
- W3034510509 hasRelatedWork W2875525199 @default.
- W3034510509 hasRelatedWork W2923191059 @default.
- W3034510509 hasRelatedWork W2940040251 @default.