Matches in SemOpenAlex for { <https://semopenalex.org/work/W3128855217> ?p ?o ?g. }
Showing items 1 to 77 of
77
with 100 items per page.
- W3128855217 abstract "Current deep learning (DL) systems rely on a centralized computing paradigm which limits the amount of available training data, increases system latency, and adds privacy and security constraints. On-device learning, enabled by decentralized and distributed training of DL models over peer-to-peer wirelessly connected edge devices, not only alleviate the above limitations but also enable next-gen applications that need DL models to continuously interact and learn from their environment. However, this necessitates the development of novel training algorithms that train DL models over time-varying and directed peer-to-peer graph structures while minimizing the amount of communication between the devices and also being resilient to non-IID data distributions. In this work we propose, Sparse-Push, a communication efficient decentralized distributed training algorithm that supports training over peer-to-peer, directed, and time-varying graph topologies. The proposed algorithm enables 466x reduction in communication with only 1% degradation in performance when training various DL models such as ResNet-20 and VGG11 over the CIFAR-10 dataset. Further, we demonstrate how communication compression can lead to significant performance degradation in-case of non-IID datasets, and propose Skew-Compensated Sparse Push algorithm that recovers this performance drop while maintaining similar levels of communication compression." @default.
- W3128855217 created "2021-02-15" @default.
- W3128855217 creator A5005856256 @default.
- W3128855217 creator A5058504747 @default.
- W3128855217 creator A5088933304 @default.
- W3128855217 date "2021-02-10" @default.
- W3128855217 modified "2023-09-27" @default.
- W3128855217 title "Sparse-Push: Communication- & Energy-Efficient Decentralized Distributed Learning over Directed & Time-Varying Graphs with non-IID Datasets." @default.
- W3128855217 cites W2044212084 @default.
- W3128855217 cites W2137435346 @default.
- W3128855217 cites W2165469059 @default.
- W3128855217 cites W2769644379 @default.
- W3128855217 cites W2789243870 @default.
- W3128855217 cites W2889676205 @default.
- W3128855217 cites W2902410171 @default.
- W3128855217 cites W2911327153 @default.
- W3128855217 cites W2962771678 @default.
- W3128855217 cites W2962863496 @default.
- W3128855217 cites W2963228337 @default.
- W3128855217 cites W2996118901 @default.
- W3128855217 cites W3034713518 @default.
- W3128855217 cites W3035449881 @default.
- W3128855217 hasPublicationYear "2021" @default.
- W3128855217 type Work @default.
- W3128855217 sameAs 3128855217 @default.
- W3128855217 citedByCount "0" @default.
- W3128855217 crossrefType "posted-content" @default.
- W3128855217 hasAuthorship W3128855217A5005856256 @default.
- W3128855217 hasAuthorship W3128855217A5058504747 @default.
- W3128855217 hasAuthorship W3128855217A5088933304 @default.
- W3128855217 hasConcept C120314980 @default.
- W3128855217 hasConcept C132525143 @default.
- W3128855217 hasConcept C199845137 @default.
- W3128855217 hasConcept C31258907 @default.
- W3128855217 hasConcept C41008148 @default.
- W3128855217 hasConcept C43711488 @default.
- W3128855217 hasConcept C534932454 @default.
- W3128855217 hasConcept C76155785 @default.
- W3128855217 hasConcept C80444323 @default.
- W3128855217 hasConcept C82876162 @default.
- W3128855217 hasConceptScore W3128855217C120314980 @default.
- W3128855217 hasConceptScore W3128855217C132525143 @default.
- W3128855217 hasConceptScore W3128855217C199845137 @default.
- W3128855217 hasConceptScore W3128855217C31258907 @default.
- W3128855217 hasConceptScore W3128855217C41008148 @default.
- W3128855217 hasConceptScore W3128855217C43711488 @default.
- W3128855217 hasConceptScore W3128855217C534932454 @default.
- W3128855217 hasConceptScore W3128855217C76155785 @default.
- W3128855217 hasConceptScore W3128855217C80444323 @default.
- W3128855217 hasConceptScore W3128855217C82876162 @default.
- W3128855217 hasLocation W31288552171 @default.
- W3128855217 hasOpenAccess W3128855217 @default.
- W3128855217 hasPrimaryLocation W31288552171 @default.
- W3128855217 hasRelatedWork W2048330777 @default.
- W3128855217 hasRelatedWork W2897021175 @default.
- W3128855217 hasRelatedWork W2963889845 @default.
- W3128855217 hasRelatedWork W2981971208 @default.
- W3128855217 hasRelatedWork W3004240240 @default.
- W3128855217 hasRelatedWork W3006843277 @default.
- W3128855217 hasRelatedWork W3007639695 @default.
- W3128855217 hasRelatedWork W3014950839 @default.
- W3128855217 hasRelatedWork W3138409184 @default.
- W3128855217 hasRelatedWork W3155415667 @default.
- W3128855217 hasRelatedWork W3159109662 @default.
- W3128855217 hasRelatedWork W3164046003 @default.
- W3128855217 hasRelatedWork W3166992878 @default.
- W3128855217 hasRelatedWork W3182946142 @default.
- W3128855217 hasRelatedWork W3183596499 @default.
- W3128855217 hasRelatedWork W3192649393 @default.
- W3128855217 hasRelatedWork W3196463200 @default.
- W3128855217 hasRelatedWork W3202331934 @default.
- W3128855217 hasRelatedWork W3206114081 @default.
- W3128855217 hasRelatedWork W3210969948 @default.
- W3128855217 isParatext "false" @default.
- W3128855217 isRetracted "false" @default.
- W3128855217 magId "3128855217" @default.
- W3128855217 workType "article" @default.