Matches in SemOpenAlex for { <https://semopenalex.org/work/W4226201194> ?p ?o ?g. }
Showing items 1 to 83 of
83
with 100 items per page.
- W4226201194 abstract "Communication cost is the main bottleneck for the design of effective distributed learning algorithms. Recently, event-triggered techniques have been proposed to reduce the exchanged information among compute nodes and thus alleviate the communication cost. However, most existing event-triggered approaches only consider heuristic event-triggered thresholds. They also ignore the impact of computation and network delay, which play an important role on the training performance. In this paper, we propose an Asynchronous Event-triggered Stochastic Gradient Descent (SGD) framework, called AET-SGD, to i) reduce the communication cost among the compute nodes, and ii) mitigate the impact of the delay. Compared with baseline event-triggered methods, AET-SGD employs a linear increasing sample size event-triggered threshold, and can significantly reduce the communication cost while keeping good convergence performance. We implement AET-SGD and evaluate its performance on multiple representative data sets, including MNIST, FashionMNIST, KMNIST and CIFAR10. The experimental results validate the correctness of the design and show a significant communication cost reduction from 44x to 120x, compared to the state of the art. Our results also show that AET-SGD can resist large delay from the straggler nodes while obtaining a decent performance and a desired speedup ratio." @default.
- W4226201194 created "2022-05-05" @default.
- W4226201194 creator A5005701424 @default.
- W4226201194 creator A5026487799 @default.
- W4226201194 date "2021-12-27" @default.
- W4226201194 modified "2023-09-26" @default.
- W4226201194 title "AET-SGD: Asynchronous Event-triggered Stochastic Gradient Descent" @default.
- W4226201194 doi "https://doi.org/10.48550/arxiv.2112.13935" @default.
- W4226201194 hasPublicationYear "2021" @default.
- W4226201194 type Work @default.
- W4226201194 citedByCount "0" @default.
- W4226201194 crossrefType "posted-content" @default.
- W4226201194 hasAuthorship W4226201194A5005701424 @default.
- W4226201194 hasAuthorship W4226201194A5026487799 @default.
- W4226201194 hasBestOaLocation W42262011941 @default.
- W4226201194 hasConcept C108583219 @default.
- W4226201194 hasConcept C111335779 @default.
- W4226201194 hasConcept C11413529 @default.
- W4226201194 hasConcept C120314980 @default.
- W4226201194 hasConcept C121332964 @default.
- W4226201194 hasConcept C149635348 @default.
- W4226201194 hasConcept C151319957 @default.
- W4226201194 hasConcept C154945302 @default.
- W4226201194 hasConcept C162324750 @default.
- W4226201194 hasConcept C173608175 @default.
- W4226201194 hasConcept C190502265 @default.
- W4226201194 hasConcept C206688291 @default.
- W4226201194 hasConcept C2524010 @default.
- W4226201194 hasConcept C2777303404 @default.
- W4226201194 hasConcept C2779662365 @default.
- W4226201194 hasConcept C2780513914 @default.
- W4226201194 hasConcept C31258907 @default.
- W4226201194 hasConcept C33923547 @default.
- W4226201194 hasConcept C41008148 @default.
- W4226201194 hasConcept C45374587 @default.
- W4226201194 hasConcept C50522688 @default.
- W4226201194 hasConcept C50644808 @default.
- W4226201194 hasConcept C55439883 @default.
- W4226201194 hasConcept C62520636 @default.
- W4226201194 hasConcept C68339613 @default.
- W4226201194 hasConcept C79403827 @default.
- W4226201194 hasConceptScore W4226201194C108583219 @default.
- W4226201194 hasConceptScore W4226201194C111335779 @default.
- W4226201194 hasConceptScore W4226201194C11413529 @default.
- W4226201194 hasConceptScore W4226201194C120314980 @default.
- W4226201194 hasConceptScore W4226201194C121332964 @default.
- W4226201194 hasConceptScore W4226201194C149635348 @default.
- W4226201194 hasConceptScore W4226201194C151319957 @default.
- W4226201194 hasConceptScore W4226201194C154945302 @default.
- W4226201194 hasConceptScore W4226201194C162324750 @default.
- W4226201194 hasConceptScore W4226201194C173608175 @default.
- W4226201194 hasConceptScore W4226201194C190502265 @default.
- W4226201194 hasConceptScore W4226201194C206688291 @default.
- W4226201194 hasConceptScore W4226201194C2524010 @default.
- W4226201194 hasConceptScore W4226201194C2777303404 @default.
- W4226201194 hasConceptScore W4226201194C2779662365 @default.
- W4226201194 hasConceptScore W4226201194C2780513914 @default.
- W4226201194 hasConceptScore W4226201194C31258907 @default.
- W4226201194 hasConceptScore W4226201194C33923547 @default.
- W4226201194 hasConceptScore W4226201194C41008148 @default.
- W4226201194 hasConceptScore W4226201194C45374587 @default.
- W4226201194 hasConceptScore W4226201194C50522688 @default.
- W4226201194 hasConceptScore W4226201194C50644808 @default.
- W4226201194 hasConceptScore W4226201194C55439883 @default.
- W4226201194 hasConceptScore W4226201194C62520636 @default.
- W4226201194 hasConceptScore W4226201194C68339613 @default.
- W4226201194 hasConceptScore W4226201194C79403827 @default.
- W4226201194 hasLocation W42262011941 @default.
- W4226201194 hasOpenAccess W4226201194 @default.
- W4226201194 hasPrimaryLocation W42262011941 @default.
- W4226201194 hasRelatedWork W2133123956 @default.
- W4226201194 hasRelatedWork W2259324379 @default.
- W4226201194 hasRelatedWork W2364921833 @default.
- W4226201194 hasRelatedWork W2377725142 @default.
- W4226201194 hasRelatedWork W2888555799 @default.
- W4226201194 hasRelatedWork W2949526915 @default.
- W4226201194 hasRelatedWork W3127965231 @default.
- W4226201194 hasRelatedWork W4245208434 @default.
- W4226201194 hasRelatedWork W4312225749 @default.
- W4226201194 hasRelatedWork W4365143671 @default.
- W4226201194 isParatext "false" @default.
- W4226201194 isRetracted "false" @default.
- W4226201194 workType "article" @default.