Matches in SemOpenAlex for { <https://semopenalex.org/work/W4308244816> ?p ?o ?g. }
Showing items 1 to 79 of
79
with 100 items per page.
- W4308244816 abstract "Composition optimization recently appears in many machine learning applications such as meta learning and reinforcement learning. Recently many composition optimization algorithms have been proposed and studied, however, few adaptive algorithm considers the composition optimization under the distributed setting. Meanwhile, the existing distributed composition optimization methods still suffer from high sample and communication complexities. In the paper, thus, we develop a class of faster momentum-based federated compositional gradient descent algorithms (i.e., MFCGD and AdaMFCGD) to solve the nonconvex distributed composition problems, which builds on the momentum-based variance reduced and local-SGD techniques. In particular, our adaptive algorithm (i.e., AdaMFCGD) uses a unified adaptive matrix to flexibly incorporate various adaptive learning rates. Moreover, we provide a solid theoretical analysis for our algorithms under non-i.i.d. setting, and prove our algorithms obtain a lower sample and communication complexities simultaneously than the existing federated compositional algorithms. Specifically, our algorithms obtain lower sample complexity of $tilde{O}(epsilon^{-3})$ with lower communication complexity of $tilde{O}(epsilon^{-2})$ in finding an $epsilon$-stationary point. We conduct the experiments on robust federated learning and distributed meta learning tasks to demonstrate efficiency of our algorithms." @default.
- W4308244816 created "2022-11-09" @default.
- W4308244816 creator A5033768689 @default.
- W4308244816 date "2022-11-03" @default.
- W4308244816 modified "2023-10-01" @default.
- W4308244816 title "Faster Adaptive Momentum-Based Federated Methods for Distributed Composition Optimization" @default.
- W4308244816 doi "https://doi.org/10.48550/arxiv.2211.01883" @default.
- W4308244816 hasPublicationYear "2022" @default.
- W4308244816 type Work @default.
- W4308244816 citedByCount "0" @default.
- W4308244816 crossrefType "posted-content" @default.
- W4308244816 hasAuthorship W4308244816A5033768689 @default.
- W4308244816 hasBestOaLocation W43082448161 @default.
- W4308244816 hasConcept C10138342 @default.
- W4308244816 hasConcept C11413529 @default.
- W4308244816 hasConcept C119857082 @default.
- W4308244816 hasConcept C125014702 @default.
- W4308244816 hasConcept C126255220 @default.
- W4308244816 hasConcept C134306372 @default.
- W4308244816 hasConcept C137836250 @default.
- W4308244816 hasConcept C138885662 @default.
- W4308244816 hasConcept C153258448 @default.
- W4308244816 hasConcept C154945302 @default.
- W4308244816 hasConcept C162324750 @default.
- W4308244816 hasConcept C185592680 @default.
- W4308244816 hasConcept C198531522 @default.
- W4308244816 hasConcept C2778445095 @default.
- W4308244816 hasConcept C2987595161 @default.
- W4308244816 hasConcept C2992525071 @default.
- W4308244816 hasConcept C33923547 @default.
- W4308244816 hasConcept C40231798 @default.
- W4308244816 hasConcept C41008148 @default.
- W4308244816 hasConcept C41895202 @default.
- W4308244816 hasConcept C43617362 @default.
- W4308244816 hasConcept C50644808 @default.
- W4308244816 hasConcept C60718061 @default.
- W4308244816 hasConcept C77618280 @default.
- W4308244816 hasConcept C97541855 @default.
- W4308244816 hasConceptScore W4308244816C10138342 @default.
- W4308244816 hasConceptScore W4308244816C11413529 @default.
- W4308244816 hasConceptScore W4308244816C119857082 @default.
- W4308244816 hasConceptScore W4308244816C125014702 @default.
- W4308244816 hasConceptScore W4308244816C126255220 @default.
- W4308244816 hasConceptScore W4308244816C134306372 @default.
- W4308244816 hasConceptScore W4308244816C137836250 @default.
- W4308244816 hasConceptScore W4308244816C138885662 @default.
- W4308244816 hasConceptScore W4308244816C153258448 @default.
- W4308244816 hasConceptScore W4308244816C154945302 @default.
- W4308244816 hasConceptScore W4308244816C162324750 @default.
- W4308244816 hasConceptScore W4308244816C185592680 @default.
- W4308244816 hasConceptScore W4308244816C198531522 @default.
- W4308244816 hasConceptScore W4308244816C2778445095 @default.
- W4308244816 hasConceptScore W4308244816C2987595161 @default.
- W4308244816 hasConceptScore W4308244816C2992525071 @default.
- W4308244816 hasConceptScore W4308244816C33923547 @default.
- W4308244816 hasConceptScore W4308244816C40231798 @default.
- W4308244816 hasConceptScore W4308244816C41008148 @default.
- W4308244816 hasConceptScore W4308244816C41895202 @default.
- W4308244816 hasConceptScore W4308244816C43617362 @default.
- W4308244816 hasConceptScore W4308244816C50644808 @default.
- W4308244816 hasConceptScore W4308244816C60718061 @default.
- W4308244816 hasConceptScore W4308244816C77618280 @default.
- W4308244816 hasConceptScore W4308244816C97541855 @default.
- W4308244816 hasLocation W43082448161 @default.
- W4308244816 hasOpenAccess W4308244816 @default.
- W4308244816 hasPrimaryLocation W43082448161 @default.
- W4308244816 hasRelatedWork W2792383975 @default.
- W4308244816 hasRelatedWork W2923496202 @default.
- W4308244816 hasRelatedWork W2973438361 @default.
- W4308244816 hasRelatedWork W3002769442 @default.
- W4308244816 hasRelatedWork W3022038857 @default.
- W4308244816 hasRelatedWork W3191556308 @default.
- W4308244816 hasRelatedWork W4212792472 @default.
- W4308244816 hasRelatedWork W4226283576 @default.
- W4308244816 hasRelatedWork W4287063340 @default.
- W4308244816 hasRelatedWork W4298051237 @default.
- W4308244816 isParatext "false" @default.
- W4308244816 isRetracted "false" @default.
- W4308244816 workType "article" @default.