Matches in SemOpenAlex for { <https://semopenalex.org/work/W4226025883> ?p ?o ?g. }
Showing items 1 to 77 of
77
with 100 items per page.
- W4226025883 abstract "Distributed training algorithms of deep neural networks show impressive convergence speedup properties on very large problems. However, they inherently suffer from communication related slowdowns and communication topology becomes a crucial design choice. Common approaches supported by most machine learning frameworks are: 1) Synchronous decentralized algorithms relying on a peer-to-peer All Reduce topology that is sensitive to stragglers and communication delays. 2) Asynchronous centralised algorithms with a server based topology that is prone to communication bottleneck. Researchers also suggested asynchronous decentralized algorithms designed to avoid the bottleneck and speedup training, however, those commonly use inexact sparse averaging that may lead to a degradation in accuracy. In this paper, we propose Local Asynchronous SGD (LASGD), an asynchronous decentralized algorithm that relies on All Reduce for model synchronization. We empirically validate LASGD's performance on image classification tasks on the ImageNet dataset. Our experiments demonstrate that LASGD accelerates training compared to SGD and state of the art gossip based approaches." @default.
- W4226025883 created "2022-05-05" @default.
- W4226025883 creator A5037147744 @default.
- W4226025883 creator A5069122415 @default.
- W4226025883 date "2022-03-24" @default.
- W4226025883 modified "2023-09-26" @default.
- W4226025883 title "Locally Asynchronous Stochastic Gradient Descent for Decentralised Deep Learning" @default.
- W4226025883 doi "https://doi.org/10.48550/arxiv.2203.13085" @default.
- W4226025883 hasPublicationYear "2022" @default.
- W4226025883 type Work @default.
- W4226025883 citedByCount "0" @default.
- W4226025883 crossrefType "posted-content" @default.
- W4226025883 hasAuthorship W4226025883A5037147744 @default.
- W4226025883 hasAuthorship W4226025883A5069122415 @default.
- W4226025883 hasBestOaLocation W42260258831 @default.
- W4226025883 hasConcept C114614502 @default.
- W4226025883 hasConcept C120314980 @default.
- W4226025883 hasConcept C127162648 @default.
- W4226025883 hasConcept C149635348 @default.
- W4226025883 hasConcept C151319957 @default.
- W4226025883 hasConcept C154945302 @default.
- W4226025883 hasConcept C15744967 @default.
- W4226025883 hasConcept C162324750 @default.
- W4226025883 hasConcept C173608175 @default.
- W4226025883 hasConcept C184720557 @default.
- W4226025883 hasConcept C199845137 @default.
- W4226025883 hasConcept C206688291 @default.
- W4226025883 hasConcept C2777303404 @default.
- W4226025883 hasConcept C2778562939 @default.
- W4226025883 hasConcept C2780513914 @default.
- W4226025883 hasConcept C31258907 @default.
- W4226025883 hasConcept C33923547 @default.
- W4226025883 hasConcept C41008148 @default.
- W4226025883 hasConcept C50522688 @default.
- W4226025883 hasConcept C50644808 @default.
- W4226025883 hasConcept C62989814 @default.
- W4226025883 hasConcept C68339613 @default.
- W4226025883 hasConcept C77805123 @default.
- W4226025883 hasConceptScore W4226025883C114614502 @default.
- W4226025883 hasConceptScore W4226025883C120314980 @default.
- W4226025883 hasConceptScore W4226025883C127162648 @default.
- W4226025883 hasConceptScore W4226025883C149635348 @default.
- W4226025883 hasConceptScore W4226025883C151319957 @default.
- W4226025883 hasConceptScore W4226025883C154945302 @default.
- W4226025883 hasConceptScore W4226025883C15744967 @default.
- W4226025883 hasConceptScore W4226025883C162324750 @default.
- W4226025883 hasConceptScore W4226025883C173608175 @default.
- W4226025883 hasConceptScore W4226025883C184720557 @default.
- W4226025883 hasConceptScore W4226025883C199845137 @default.
- W4226025883 hasConceptScore W4226025883C206688291 @default.
- W4226025883 hasConceptScore W4226025883C2777303404 @default.
- W4226025883 hasConceptScore W4226025883C2778562939 @default.
- W4226025883 hasConceptScore W4226025883C2780513914 @default.
- W4226025883 hasConceptScore W4226025883C31258907 @default.
- W4226025883 hasConceptScore W4226025883C33923547 @default.
- W4226025883 hasConceptScore W4226025883C41008148 @default.
- W4226025883 hasConceptScore W4226025883C50522688 @default.
- W4226025883 hasConceptScore W4226025883C50644808 @default.
- W4226025883 hasConceptScore W4226025883C62989814 @default.
- W4226025883 hasConceptScore W4226025883C68339613 @default.
- W4226025883 hasConceptScore W4226025883C77805123 @default.
- W4226025883 hasLocation W42260258831 @default.
- W4226025883 hasOpenAccess W4226025883 @default.
- W4226025883 hasPrimaryLocation W42260258831 @default.
- W4226025883 hasRelatedWork W2034120741 @default.
- W4226025883 hasRelatedWork W2124870959 @default.
- W4226025883 hasRelatedWork W2133123956 @default.
- W4226025883 hasRelatedWork W2364921833 @default.
- W4226025883 hasRelatedWork W2777981407 @default.
- W4226025883 hasRelatedWork W2949952845 @default.
- W4226025883 hasRelatedWork W4226025883 @default.
- W4226025883 hasRelatedWork W4242837953 @default.
- W4226025883 hasRelatedWork W4249402901 @default.
- W4226025883 hasRelatedWork W4298840580 @default.
- W4226025883 isParatext "false" @default.
- W4226025883 isRetracted "false" @default.
- W4226025883 workType "article" @default.