FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3129097267> ?p ?o ?g. }

• W3129097267 abstract "Recently, local SGD has got much attention and been extensively studied in the distributed learning community to overcome the communication bottleneck problem. However, the superiority of local SGD to minibatch SGD only holds in quite limited situations. In this paper, we study a new local algorithm called Bias-Variance Reduced Local SGD (BVR-L-SGD) for nonconvex distributed optimization. Algorithmically, our proposed bias and variance reduced local gradient estimator fully utilizes small second-order heterogeneity of local objectives and suggests randomly picking up one of the local models instead of taking the average of them when workers are synchronized. Theoretically, under small heterogeneity of local objectives, we show that BVR-L-SGD achieves better communication complexity than both the previous non-local and local methods under mild conditions, and particularly BVR-L-SGD is the first method that breaks the barrier of communication complexity $Theta(1/varepsilon)$ for general nonconvex smooth objectives when the heterogeneity is small and the local computation budget is large. Numerical results are given to verify the theoretical findings and give empirical evidence of the superiority of our method." @default.
• W3129097267 created "2021-02-15" @default.
• W3129097267 creator A5065727065 @default.
• W3129097267 creator A5078812767 @default.
• W3129097267 date "2021-02-05" @default.
• W3129097267 modified "2023-10-01" @default.
• W3129097267 title "Bias-Variance Reduced Local SGD for Less Heterogeneous Federated Learning." @default.
• W3129097267 cites W1533861849 @default.
• W3129097267 cites W2053637704 @default.
• W3129097267 cites W2107438106 @default.
• W3129097267 cites W2116612304 @default.
• W3129097267 cites W2130062883 @default.
• W3129097267 cites W2510078447 @default.
• W3129097267 cites W2541884796 @default.
• W3129097267 cites W2622263826 @default.
• W3129097267 cites W2729157799 @default.
• W3129097267 cites W2803867449 @default.
• W3129097267 cites W2808953177 @default.
• W3129097267 cites W2888206291 @default.
• W3129097267 cites W2896422817 @default.
• W3129097267 cites W2900120080 @default.
• W3129097267 cites W2900182564 @default.
• W3129097267 cites W2942057781 @default.
• W3129097267 cites W2962696654 @default.
• W3129097267 cites W2962851402 @default.
• W3129097267 cites W2963092340 @default.
• W3129097267 cites W2963411541 @default.
• W3129097267 cites W2963965485 @default.
• W3129097267 cites W2964106499 @default.
• W3129097267 cites W2971032006 @default.
• W3129097267 cites W2982408624 @default.
• W3129097267 cites W2982654255 @default.
• W3129097267 cites W2994972952 @default.
• W3129097267 cites W2995022099 @default.
• W3129097267 cites W3033462932 @default.
• W3129097267 cites W3034666238 @default.
• W3129097267 cites W3034741284 @default.
• W3129097267 cites W3035507578 @default.
• W3129097267 cites W3037674069 @default.
• W3129097267 cites W3047989515 @default.
• W3129097267 cites W3132575741 @default.
• W3129097267 hasPublicationYear "2021" @default.
• W3129097267 type Work @default.
• W3129097267 sameAs 3129097267 @default.
• W3129097267 citedByCount "0" @default.
• W3129097267 crossrefType "posted-content" @default.
• W3129097267 hasAuthorship W3129097267A5065727065 @default.
• W3129097267 hasAuthorship W3129097267A5078812767 @default.
• W3129097267 hasConcept C105795698 @default.
• W3129097267 hasConcept C11413529 @default.
• W3129097267 hasConcept C121955636 @default.
• W3129097267 hasConcept C126255220 @default.
• W3129097267 hasConcept C135320971 @default.
• W3129097267 hasConcept C141934464 @default.
• W3129097267 hasConcept C149635348 @default.
• W3129097267 hasConcept C162324750 @default.
• W3129097267 hasConcept C185429906 @default.
• W3129097267 hasConcept C196083921 @default.
• W3129097267 hasConcept C2780513914 @default.
• W3129097267 hasConcept C33923547 @default.
• W3129097267 hasConcept C41008148 @default.
• W3129097267 hasConcept C45374587 @default.
• W3129097267 hasConceptScore W3129097267C105795698 @default.
• W3129097267 hasConceptScore W3129097267C11413529 @default.
• W3129097267 hasConceptScore W3129097267C121955636 @default.
• W3129097267 hasConceptScore W3129097267C126255220 @default.
• W3129097267 hasConceptScore W3129097267C135320971 @default.
• W3129097267 hasConceptScore W3129097267C141934464 @default.
• W3129097267 hasConceptScore W3129097267C149635348 @default.
• W3129097267 hasConceptScore W3129097267C162324750 @default.
• W3129097267 hasConceptScore W3129097267C185429906 @default.
• W3129097267 hasConceptScore W3129097267C196083921 @default.
• W3129097267 hasConceptScore W3129097267C2780513914 @default.
• W3129097267 hasConceptScore W3129097267C33923547 @default.
• W3129097267 hasConceptScore W3129097267C41008148 @default.
• W3129097267 hasConceptScore W3129097267C45374587 @default.
• W3129097267 hasLocation W31290972671 @default.
• W3129097267 hasOpenAccess W3129097267 @default.
• W3129097267 hasPrimaryLocation W31290972671 @default.
• W3129097267 hasRelatedWork W2460815216 @default.
• W3129097267 hasRelatedWork W2619516334 @default.
• W3129097267 hasRelatedWork W2904935195 @default.
• W3129097267 hasRelatedWork W2950351588 @default.
• W3129097267 hasRelatedWork W2963520461 @default.
• W3129097267 hasRelatedWork W2963625269 @default.
• W3129097267 hasRelatedWork W2972768970 @default.
• W3129097267 hasRelatedWork W2992794988 @default.
• W3129097267 hasRelatedWork W3001825675 @default.
• W3129097267 hasRelatedWork W3024569256 @default.
• W3129097267 hasRelatedWork W3035253236 @default.
• W3129097267 hasRelatedWork W3035507578 @default.
• W3129097267 hasRelatedWork W3036912620 @default.
• W3129097267 hasRelatedWork W3037261120 @default.
• W3129097267 hasRelatedWork W3037743336 @default.
• W3129097267 hasRelatedWork W3039110859 @default.
• W3129097267 hasRelatedWork W3103375947 @default.
• W3129097267 hasRelatedWork W3172737510 @default.
• W3129097267 hasRelatedWork W3178427280 @default.
• W3129097267 hasRelatedWork W3184545962 @default.
• W3129097267 isParatext "false" @default.

• next