FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3013308737> ?p ?o ?g. }

• W3013308737 abstract "Distributed Stochastic Gradient Descent (SGD) when run in a synchronous manner, suffers from delays in runtime as it waits for the slowest workers (stragglers). Asynchronous methods can alleviate stragglers, but cause gradient staleness that can adversely affect the convergence error. In this work, we present a novel theoretical characterization of the speedup offered by asynchronous methods by analyzing the trade-off between the error in the trained model and the actual training runtime(wallclock time). The main novelty in our work is that our runtime analysis considers random straggling delays, which helps us design and compare distributed SGD algorithms that strike a balance between straggling and staleness. We also provide a new error convergence analysis of asynchronous SGD variants without bounded or exponential delay assumptions. Finally, based on our theoretical characterization of the error-runtime trade-off, we propose a method of gradually varying synchronicity in distributed SGD and demonstrate its performance on CIFAR10 dataset." @default.
• W3013308737 created "2020-04-03" @default.
• W3013308737 creator A5035222388 @default.
• W3013308737 creator A5050613147 @default.
• W3013308737 creator A5067441201 @default.
• W3013308737 date "2020-03-23" @default.
• W3013308737 modified "2023-09-27" @default.
• W3013308737 title "Slow and Stale Gradients Can Win the Race" @default.
• W3013308737 cites W1497601926 @default.
• W3013308737 cites W1652793671 @default.
• W3013308737 cites W1833917188 @default.
• W3013308737 cites W1982063824 @default.
• W3013308737 cites W1994574815 @default.
• W3013308737 cites W1994616650 @default.
• W3013308737 cites W2064224609 @default.
• W3013308737 cites W2072566913 @default.
• W3013308737 cites W2098290609 @default.
• W3013308737 cites W2105875671 @default.
• W3013308737 cites W2107438106 @default.
• W3013308737 cites W2130062883 @default.
• W3013308737 cites W2132737349 @default.
• W3013308737 cites W2138243089 @default.
• W3013308737 cites W2146502635 @default.
• W3013308737 cites W2154834860 @default.
• W3013308737 cites W2168231600 @default.
• W3013308737 cites W2188647300 @default.
• W3013308737 cites W2336650964 @default.
• W3013308737 cites W2436219157 @default.
• W3013308737 cites W2460815216 @default.
• W3013308737 cites W2523246573 @default.
• W3013308737 cites W2523435939 @default.
• W3013308737 cites W2535838896 @default.
• W3013308737 cites W2541884796 @default.
• W3013308737 cites W2556205507 @default.
• W3013308737 cites W2569020760 @default.
• W3013308737 cites W2619493178 @default.
• W3013308737 cites W2699326867 @default.
• W3013308737 cites W2736152588 @default.
• W3013308737 cites W2741736887 @default.
• W3013308737 cites W2742582805 @default.
• W3013308737 cites W2746032536 @default.
• W3013308737 cites W2751625010 @default.
• W3013308737 cites W2757498728 @default.
• W3013308737 cites W2769892987 @default.
• W3013308737 cites W2798525132 @default.
• W3013308737 cites W2888561381 @default.
• W3013308737 cites W2896633576 @default.
• W3013308737 cites W2946076799 @default.
• W3013308737 cites W2962696654 @default.
• W3013308737 cites W2962873681 @default.
• W3013308737 cites W2962950660 @default.
• W3013308737 cites W2962952793 @default.
• W3013308737 cites W2962957061 @default.
• W3013308737 cites W2963138848 @default.
• W3013308737 cites W2963361660 @default.
• W3013308737 cites W2963489801 @default.
• W3013308737 cites W2963531643 @default.
• W3013308737 cites W2963706835 @default.
• W3013308737 cites W2963792515 @default.
• W3013308737 cites W2963804082 @default.
• W3013308737 cites W2963903325 @default.
• W3013308737 cites W2963964896 @default.
• W3013308737 cites W2964092527 @default.
• W3013308737 cites W2964095159 @default.
• W3013308737 cites W2964121744 @default.
• W3013308737 cites W2964160151 @default.
• W3013308737 cites W2971208866 @default.
• W3013308737 cites W2975971390 @default.
• W3013308737 cites W2976713597 @default.
• W3013308737 cites W3037047862 @default.
• W3013308737 cites W3102816259 @default.
• W3013308737 cites W3103649678 @default.
• W3013308737 cites W3118608800 @default.
• W3013308737 cites W565955800 @default.
• W3013308737 hasPublicationYear "2020" @default.
• W3013308737 type Work @default.
• W3013308737 sameAs 3013308737 @default.
• W3013308737 citedByCount "5" @default.
• W3013308737 countsByYear W30133087372020 @default.
• W3013308737 countsByYear W30133087372021 @default.
• W3013308737 crossrefType "posted-content" @default.
• W3013308737 hasAuthorship W3013308737A5035222388 @default.
• W3013308737 hasAuthorship W3013308737A5050613147 @default.
• W3013308737 hasAuthorship W3013308737A5067441201 @default.
• W3013308737 hasConcept C11413529 @default.
• W3013308737 hasConcept C120314980 @default.
• W3013308737 hasConcept C134306372 @default.
• W3013308737 hasConcept C138885662 @default.
• W3013308737 hasConcept C151319957 @default.
• W3013308737 hasConcept C154945302 @default.
• W3013308737 hasConcept C162324750 @default.
• W3013308737 hasConcept C168021876 @default.
• W3013308737 hasConcept C173608175 @default.
• W3013308737 hasConcept C206688291 @default.
• W3013308737 hasConcept C27206212 @default.
• W3013308737 hasConcept C2777303404 @default.
• W3013308737 hasConcept C2778738651 @default.
• W3013308737 hasConcept C31258907 @default.
• W3013308737 hasConcept C33923547 @default.
• W3013308737 hasConcept C34388435 @default.

• next