FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W4382998687> ?p ?o ?g. }

• W4382998687 endingPage "441" @default.
• W4382998687 startingPage "427" @default.
• W4382998687 abstract "In this paper, we consider a strongly convex finite-sum minimization problem over a decentralized network and propose a communication-efficient decentralized Newton's method for solving it. The main challenges in designing such an algorithm come from three aspects: (i) mismatch between local gradients/Hessians and the global ones; (ii) cost of sharing second-order information; (iii) tradeoff among computation and communication. To handle these challenges, we first apply dynamic average consensus (DAC) so that each node is able to use a local gradient approximation and a local Hessian approximation to track the global gradient and Hessian, respectively. Second, since exchanging Hessian approximations is far from communication-efficient, we require the nodes to exchange the compressed ones instead and then apply an error compensation mechanism to correct for the compression noise. Third, we introduce multi-step consensus for exchanging local variables and local gradient approximations to balance between computation and communication. With novel analysis, we establish the globally linear (resp., asymptotically super-linear) convergence rate of the proposed algorithm when <inline-formula xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink><tex-math notation=LaTeX>$m$</tex-math></inline-formula> is constant (resp., tends to infinity), where <inline-formula xmlns:mml=http://www.w3.org/1998/Math/MathML xmlns:xlink=http://www.w3.org/1999/xlink><tex-math notation=LaTeX>$mge 1$</tex-math></inline-formula> is the number of consensus inner steps. To the best of our knowledge, this is the first super-linear convergence result for a communication-efficient decentralized Newton's method. Moreover, the rate we establish is provably faster than those of first-order methods. Our numerical results on various applications corroborate the theoretical findings." @default.
• W4382998687 created "2023-07-04" @default.
• W4382998687 creator A5020742575 @default.
• W4382998687 creator A5029820392 @default.
• W4382998687 creator A5072164248 @default.
• W4382998687 creator A5081454597 @default.
• W4382998687 date "2023-01-01" @default.
• W4382998687 modified "2023-10-03" @default.
• W4382998687 title "A Communication-Efficient Decentralized Newton's Method With Provably Faster Convergence" @default.
• W4382998687 cites W1553365534 @default.
• W4382998687 cites W1571416372 @default.
• W4382998687 cites W2044212084 @default.
• W4382998687 cites W2074796812 @default.
• W4382998687 cites W2091549324 @default.
• W4382998687 cites W2092620240 @default.
• W4382998687 cites W2133086339 @default.
• W4382998687 cites W2134711723 @default.
• W4382998687 cites W2537046506 @default.
• W4382998687 cites W2799114271 @default.
• W4382998687 cites W2892002891 @default.
• W4382998687 cites W2963116103 @default.
• W4382998687 cites W2963498484 @default.
• W4382998687 cites W2963596156 @default.
• W4382998687 cites W2964165783 @default.
• W4382998687 cites W2964183442 @default.
• W4382998687 cites W2969788501 @default.
• W4382998687 cites W2973303672 @default.
• W4382998687 cites W3007193855 @default.
• W4382998687 cites W3043309535 @default.
• W4382998687 cites W3083575911 @default.
• W4382998687 cites W3092262213 @default.
• W4382998687 cites W3100513551 @default.
• W4382998687 cites W3103807526 @default.
• W4382998687 cites W3149863719 @default.
• W4382998687 cites W3166352853 @default.
• W4382998687 cites W3172556047 @default.
• W4382998687 cites W3186590963 @default.
• W4382998687 cites W4207055026 @default.
• W4382998687 cites W4225530789 @default.
• W4382998687 cites W4281710948 @default.
• W4382998687 doi "https://doi.org/10.1109/tsipn.2023.3290397" @default.
• W4382998687 hasPublicationYear "2023" @default.
• W4382998687 type Work @default.
• W4382998687 citedByCount "0" @default.
• W4382998687 crossrefType "journal-article" @default.
• W4382998687 hasAuthorship W4382998687A5020742575 @default.
• W4382998687 hasAuthorship W4382998687A5029820392 @default.
• W4382998687 hasAuthorship W4382998687A5072164248 @default.
• W4382998687 hasAuthorship W4382998687A5081454597 @default.
• W4382998687 hasConcept C11413529 @default.
• W4382998687 hasConcept C126255220 @default.
• W4382998687 hasConcept C127413603 @default.
• W4382998687 hasConcept C162324750 @default.
• W4382998687 hasConcept C203616005 @default.
• W4382998687 hasConcept C26517878 @default.
• W4382998687 hasConcept C2777303404 @default.
• W4382998687 hasConcept C28826006 @default.
• W4382998687 hasConcept C33923547 @default.
• W4382998687 hasConcept C38652104 @default.
• W4382998687 hasConcept C41008148 @default.
• W4382998687 hasConcept C45357846 @default.
• W4382998687 hasConcept C45374587 @default.
• W4382998687 hasConcept C50522688 @default.
• W4382998687 hasConcept C57869625 @default.
• W4382998687 hasConcept C62611344 @default.
• W4382998687 hasConcept C66938386 @default.
• W4382998687 hasConcept C94375191 @default.
• W4382998687 hasConceptScore W4382998687C11413529 @default.
• W4382998687 hasConceptScore W4382998687C126255220 @default.
• W4382998687 hasConceptScore W4382998687C127413603 @default.
• W4382998687 hasConceptScore W4382998687C162324750 @default.
• W4382998687 hasConceptScore W4382998687C203616005 @default.
• W4382998687 hasConceptScore W4382998687C26517878 @default.
• W4382998687 hasConceptScore W4382998687C2777303404 @default.
• W4382998687 hasConceptScore W4382998687C28826006 @default.
• W4382998687 hasConceptScore W4382998687C33923547 @default.
• W4382998687 hasConceptScore W4382998687C38652104 @default.
• W4382998687 hasConceptScore W4382998687C41008148 @default.
• W4382998687 hasConceptScore W4382998687C45357846 @default.
• W4382998687 hasConceptScore W4382998687C45374587 @default.
• W4382998687 hasConceptScore W4382998687C50522688 @default.
• W4382998687 hasConceptScore W4382998687C57869625 @default.
• W4382998687 hasConceptScore W4382998687C62611344 @default.
• W4382998687 hasConceptScore W4382998687C66938386 @default.
• W4382998687 hasConceptScore W4382998687C94375191 @default.
• W4382998687 hasFunder F4320321001 @default.
• W4382998687 hasFunder F4320337111 @default.
• W4382998687 hasLocation W43829986871 @default.
• W4382998687 hasOpenAccess W4382998687 @default.
• W4382998687 hasPrimaryLocation W43829986871 @default.
• W4382998687 hasRelatedWork W2025314782 @default.
• W4382998687 hasRelatedWork W2088678505 @default.
• W4382998687 hasRelatedWork W2169345436 @default.
• W4382998687 hasRelatedWork W2252674526 @default.
• W4382998687 hasRelatedWork W2912642813 @default.
• W4382998687 hasRelatedWork W2952728270 @default.
• W4382998687 hasRelatedWork W3049601810 @default.
• W4382998687 hasRelatedWork W4221159909 @default.

• next