Matches in SemOpenAlex for { <https://semopenalex.org/work/W4384268567> ?p ?o ?g. }
Showing items 1 to 59 of
59
with 100 items per page.
- W4384268567 abstract "State-of-the-art federated learning algorithms such as FedAvg require carefully tuned stepsizes to achieve their best performance. The improvements proposed by existing adaptive federated methods involve tuning of additional hyperparameters such as momentum parameters, and consider adaptivity only in the server aggregation round, but not locally. These methods can be inefficient in many practical scenarios because they require excessive tuning of hyperparameters and do not capture local geometric information. In this work, we extend the recently proposed stochastic Polyak stepsize (SPS) to the federated learning setting, and propose new locally adaptive and nearly parameter-free distributed SPS variants (FedSPS and FedDecSPS). We prove that FedSPS converges linearly in strongly convex and sublinearly in convex settings when the interpolation condition (overparametrization) is satisfied, and converges to a neighborhood of the solution in the general case. We extend our proposed method to a decreasing stepsize version FedDecSPS, that converges also when the interpolation condition does not hold. We validate our theoretical claims by performing illustrative convex experiments. Our proposed algorithms match the optimization performance of FedAvg with the best tuned hyperparameters in the i.i.d. case, and outperform FedAvg in the non-i.i.d. case." @default.
- W4384268567 created "2023-07-14" @default.
- W4384268567 creator A5045519627 @default.
- W4384268567 creator A5075390126 @default.
- W4384268567 creator A5090331266 @default.
- W4384268567 date "2023-07-12" @default.
- W4384268567 modified "2023-10-17" @default.
- W4384268567 title "Locally Adaptive Federated Learning via Stochastic Polyak Stepsizes" @default.
- W4384268567 doi "https://doi.org/10.48550/arxiv.2307.06306" @default.
- W4384268567 hasPublicationYear "2023" @default.
- W4384268567 type Work @default.
- W4384268567 citedByCount "0" @default.
- W4384268567 crossrefType "posted-content" @default.
- W4384268567 hasAuthorship W4384268567A5045519627 @default.
- W4384268567 hasAuthorship W4384268567A5075390126 @default.
- W4384268567 hasAuthorship W4384268567A5090331266 @default.
- W4384268567 hasBestOaLocation W43842685671 @default.
- W4384268567 hasConcept C104114177 @default.
- W4384268567 hasConcept C111919701 @default.
- W4384268567 hasConcept C112680207 @default.
- W4384268567 hasConcept C11413529 @default.
- W4384268567 hasConcept C126255220 @default.
- W4384268567 hasConcept C137800194 @default.
- W4384268567 hasConcept C149672232 @default.
- W4384268567 hasConcept C154945302 @default.
- W4384268567 hasConcept C2524010 @default.
- W4384268567 hasConcept C2992525071 @default.
- W4384268567 hasConcept C33923547 @default.
- W4384268567 hasConcept C41008148 @default.
- W4384268567 hasConcept C8642999 @default.
- W4384268567 hasConceptScore W4384268567C104114177 @default.
- W4384268567 hasConceptScore W4384268567C111919701 @default.
- W4384268567 hasConceptScore W4384268567C112680207 @default.
- W4384268567 hasConceptScore W4384268567C11413529 @default.
- W4384268567 hasConceptScore W4384268567C126255220 @default.
- W4384268567 hasConceptScore W4384268567C137800194 @default.
- W4384268567 hasConceptScore W4384268567C149672232 @default.
- W4384268567 hasConceptScore W4384268567C154945302 @default.
- W4384268567 hasConceptScore W4384268567C2524010 @default.
- W4384268567 hasConceptScore W4384268567C2992525071 @default.
- W4384268567 hasConceptScore W4384268567C33923547 @default.
- W4384268567 hasConceptScore W4384268567C41008148 @default.
- W4384268567 hasConceptScore W4384268567C8642999 @default.
- W4384268567 hasLocation W43842685671 @default.
- W4384268567 hasOpenAccess W4384268567 @default.
- W4384268567 hasPrimaryLocation W43842685671 @default.
- W4384268567 hasRelatedWork W2351491280 @default.
- W4384268567 hasRelatedWork W2371447506 @default.
- W4384268567 hasRelatedWork W2386767533 @default.
- W4384268567 hasRelatedWork W2751887469 @default.
- W4384268567 hasRelatedWork W303980170 @default.
- W4384268567 hasRelatedWork W3141679561 @default.
- W4384268567 hasRelatedWork W4214661097 @default.
- W4384268567 hasRelatedWork W4319970843 @default.
- W4384268567 hasRelatedWork W4323894855 @default.
- W4384268567 hasRelatedWork W4378505370 @default.
- W4384268567 isParatext "false" @default.
- W4384268567 isRetracted "false" @default.
- W4384268567 workType "article" @default.