FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3200494163> ?p ?o ?g. }

• W3200494163 abstract "Federated learning (FL) is a popular technique to train machine learning (ML) models with decentralized data. Extensive works have studied the performance of the global model; however, it is still unclear how the training process affects the final test accuracy. Exacerbating this problem is the fact that FL executions differ significantly from traditional ML with heterogeneous data characteristics across clients, involving more hyperparameters. In this work, we show that the final test accuracy of FL is dramatically affected by the early phase of the training process, i.e., FL exhibits critical learning periods, in which small gradient errors can have irrecoverable impact on the final test accuracy. To further explain this phenomenon, we generalize the trace of the Fisher Information Matrix (FIM) to FL and define a new notion called FedFIM, a quantity reflecting the local curvature of each clients from the beginning of the training in FL. Our findings suggest that the {em initial learning phase} plays a critical role in understanding the FL performance. This is in contrast to many existing works which generally do not connect the final accuracy of FL to the early phase training. Finally, seizing critical learning periods in FL is of independent interest and could be useful for other problems such as the choices of hyperparameters such as the number of client selected per round, batch size, and more, so as to improve the performance of FL training and testing." @default.
• W3200494163 created "2021-09-27" @default.
• W3200494163 creator A5012928499 @default.
• W3200494163 creator A5023638809 @default.
• W3200494163 creator A5076621655 @default.
• W3200494163 date "2021-09-12" @default.
• W3200494163 modified "2023-09-23" @default.
• W3200494163 title "Critical Learning Periods in Federated Learning." @default.
• W3200494163 cites W2194775991 @default.
• W3200494163 cites W2535838896 @default.
• W3200494163 cites W2541884796 @default.
• W3200494163 cites W2547352193 @default.
• W3200494163 cites W2591882872 @default.
• W3200494163 cites W2767079719 @default.
• W3200494163 cites W2768267830 @default.
• W3200494163 cites W2777914285 @default.
• W3200494163 cites W2904190483 @default.
• W3200494163 cites W2905444686 @default.
• W3200494163 cites W2911040189 @default.
• W3200494163 cites W2962819303 @default.
• W3200494163 cites W2963300197 @default.
• W3200494163 cites W2963318081 @default.
• W3200494163 cites W2963456518 @default.
• W3200494163 cites W2963702144 @default.
• W3200494163 cites W2970176896 @default.
• W3200494163 cites W2970408908 @default.
• W3200494163 cites W2993897137 @default.
• W3200494163 cites W2995022099 @default.
• W3200494163 cites W2995653155 @default.
• W3200494163 cites W2996736801 @default.
• W3200494163 cites W3034666238 @default.
• W3200494163 cites W3037047862 @default.
• W3200494163 cites W3038022836 @default.
• W3200494163 cites W3047304572 @default.
• W3200494163 cites W3086499488 @default.
• W3200494163 cites W3096004388 @default.
• W3200494163 cites W3115851078 @default.
• W3200494163 cites W3117548433 @default.
• W3200494163 cites W3118608800 @default.
• W3200494163 cites W3132294480 @default.
• W3200494163 cites W3135551479 @default.
• W3200494163 cites W3182125009 @default.
• W3200494163 hasPublicationYear "2021" @default.
• W3200494163 type Work @default.
• W3200494163 sameAs 3200494163 @default.
• W3200494163 citedByCount "0" @default.
• W3200494163 crossrefType "posted-content" @default.
• W3200494163 hasAuthorship W3200494163A5012928499 @default.
• W3200494163 hasAuthorship W3200494163A5023638809 @default.
• W3200494163 hasAuthorship W3200494163A5076621655 @default.
• W3200494163 hasConcept C111919701 @default.
• W3200494163 hasConcept C119857082 @default.
• W3200494163 hasConcept C121332964 @default.
• W3200494163 hasConcept C127413603 @default.
• W3200494163 hasConcept C138885662 @default.
• W3200494163 hasConcept C151730666 @default.
• W3200494163 hasConcept C153294291 @default.
• W3200494163 hasConcept C154945302 @default.
• W3200494163 hasConcept C16910744 @default.
• W3200494163 hasConcept C178790620 @default.
• W3200494163 hasConcept C185592680 @default.
• W3200494163 hasConcept C18762648 @default.
• W3200494163 hasConcept C199360897 @default.
• W3200494163 hasConcept C2776502983 @default.
• W3200494163 hasConcept C2777211547 @default.
• W3200494163 hasConcept C2777267654 @default.
• W3200494163 hasConcept C41008148 @default.
• W3200494163 hasConcept C41895202 @default.
• W3200494163 hasConcept C44280652 @default.
• W3200494163 hasConcept C75291252 @default.
• W3200494163 hasConcept C78519656 @default.
• W3200494163 hasConcept C8642999 @default.
• W3200494163 hasConcept C86803240 @default.
• W3200494163 hasConcept C98045186 @default.
• W3200494163 hasConceptScore W3200494163C111919701 @default.
• W3200494163 hasConceptScore W3200494163C119857082 @default.
• W3200494163 hasConceptScore W3200494163C121332964 @default.
• W3200494163 hasConceptScore W3200494163C127413603 @default.
• W3200494163 hasConceptScore W3200494163C138885662 @default.
• W3200494163 hasConceptScore W3200494163C151730666 @default.
• W3200494163 hasConceptScore W3200494163C153294291 @default.
• W3200494163 hasConceptScore W3200494163C154945302 @default.
• W3200494163 hasConceptScore W3200494163C16910744 @default.
• W3200494163 hasConceptScore W3200494163C178790620 @default.
• W3200494163 hasConceptScore W3200494163C185592680 @default.
• W3200494163 hasConceptScore W3200494163C18762648 @default.
• W3200494163 hasConceptScore W3200494163C199360897 @default.
• W3200494163 hasConceptScore W3200494163C2776502983 @default.
• W3200494163 hasConceptScore W3200494163C2777211547 @default.
• W3200494163 hasConceptScore W3200494163C2777267654 @default.
• W3200494163 hasConceptScore W3200494163C41008148 @default.
• W3200494163 hasConceptScore W3200494163C41895202 @default.
• W3200494163 hasConceptScore W3200494163C44280652 @default.
• W3200494163 hasConceptScore W3200494163C75291252 @default.
• W3200494163 hasConceptScore W3200494163C78519656 @default.
• W3200494163 hasConceptScore W3200494163C8642999 @default.
• W3200494163 hasConceptScore W3200494163C86803240 @default.
• W3200494163 hasConceptScore W3200494163C98045186 @default.
• W3200494163 hasOpenAccess W3200494163 @default.
• W3200494163 hasRelatedWork W1555922520 @default.

• next