Matches in SemOpenAlex for { <https://semopenalex.org/work/W3037875189> ?p ?o ?g. }
Showing items 1 to 76 of
76
with 100 items per page.
- W3037875189 abstract "State-of-the-art deep learning systems rely on iterative distributed training to tackle the increasing complexity of models and input data. The iteration time in these communication-heavy systems depends on the computation time, communication time and the extent of overlap of computation and communication. In this work, we identify a shortcoming in systems with graph representation for computation, such as TensorFlow and PyTorch, that result in high variance in iteration time --- random order of received parameters across workers. We develop a system, TicTac, to improve the iteration time by fixing this issue in distributed deep learning with Parameter Servers while guaranteeing near-optimal overlap of communication and computation. TicTac identifies and enforces an order of network transfers which improves the iteration time using prioritization. Our system is implemented over TensorFlow and requires no changes to the model or developer inputs. TicTac improves the throughput by up to $37.7%$ in inference and $19.2%$ in training, while also reducing straggler effect by up to $2.3times$. Our code is publicly available." @default.
- W3037875189 created "2020-07-02" @default.
- W3037875189 creator A5056821502 @default.
- W3037875189 creator A5058967466 @default.
- W3037875189 creator A5065622216 @default.
- W3037875189 date "2019-04-01" @default.
- W3037875189 modified "2023-09-29" @default.
- W3037875189 title "TicTac: Accelerating Distributed Deep Learning with Communication Scheduling" @default.
- W3037875189 hasPublicationYear "2019" @default.
- W3037875189 type Work @default.
- W3037875189 sameAs 3037875189 @default.
- W3037875189 citedByCount "25" @default.
- W3037875189 countsByYear W30378751892019 @default.
- W3037875189 countsByYear W30378751892020 @default.
- W3037875189 countsByYear W30378751892021 @default.
- W3037875189 crossrefType "proceedings-article" @default.
- W3037875189 hasAuthorship W3037875189A5056821502 @default.
- W3037875189 hasAuthorship W3037875189A5058967466 @default.
- W3037875189 hasAuthorship W3037875189A5065622216 @default.
- W3037875189 hasConcept C101765175 @default.
- W3037875189 hasConcept C108583219 @default.
- W3037875189 hasConcept C11413529 @default.
- W3037875189 hasConcept C119857082 @default.
- W3037875189 hasConcept C120314980 @default.
- W3037875189 hasConcept C126255220 @default.
- W3037875189 hasConcept C154945302 @default.
- W3037875189 hasConcept C206729178 @default.
- W3037875189 hasConcept C2776214188 @default.
- W3037875189 hasConcept C31258907 @default.
- W3037875189 hasConcept C33923547 @default.
- W3037875189 hasConcept C41008148 @default.
- W3037875189 hasConcept C45374587 @default.
- W3037875189 hasConcept C80444323 @default.
- W3037875189 hasConcept C93996380 @default.
- W3037875189 hasConceptScore W3037875189C101765175 @default.
- W3037875189 hasConceptScore W3037875189C108583219 @default.
- W3037875189 hasConceptScore W3037875189C11413529 @default.
- W3037875189 hasConceptScore W3037875189C119857082 @default.
- W3037875189 hasConceptScore W3037875189C120314980 @default.
- W3037875189 hasConceptScore W3037875189C126255220 @default.
- W3037875189 hasConceptScore W3037875189C154945302 @default.
- W3037875189 hasConceptScore W3037875189C206729178 @default.
- W3037875189 hasConceptScore W3037875189C2776214188 @default.
- W3037875189 hasConceptScore W3037875189C31258907 @default.
- W3037875189 hasConceptScore W3037875189C33923547 @default.
- W3037875189 hasConceptScore W3037875189C41008148 @default.
- W3037875189 hasConceptScore W3037875189C45374587 @default.
- W3037875189 hasConceptScore W3037875189C80444323 @default.
- W3037875189 hasConceptScore W3037875189C93996380 @default.
- W3037875189 hasLocation W30378751891 @default.
- W3037875189 hasOpenAccess W3037875189 @default.
- W3037875189 hasPrimaryLocation W30378751891 @default.
- W3037875189 hasRelatedWork W1686810756 @default.
- W3037875189 hasRelatedWork W2083842231 @default.
- W3037875189 hasRelatedWork W2117539524 @default.
- W3037875189 hasRelatedWork W2132737349 @default.
- W3037875189 hasRelatedWork W2163605009 @default.
- W3037875189 hasRelatedWork W2168231600 @default.
- W3037875189 hasRelatedWork W2186615578 @default.
- W3037875189 hasRelatedWork W2194775991 @default.
- W3037875189 hasRelatedWork W2402144811 @default.
- W3037875189 hasRelatedWork W2622263826 @default.
- W3037875189 hasRelatedWork W2769644379 @default.
- W3037875189 hasRelatedWork W2787998955 @default.
- W3037875189 hasRelatedWork W2798515322 @default.
- W3037875189 hasRelatedWork W2962758826 @default.
- W3037875189 hasRelatedWork W2963341956 @default.
- W3037875189 hasRelatedWork W2963803379 @default.
- W3037875189 hasRelatedWork W2964004663 @default.
- W3037875189 hasRelatedWork W2975712713 @default.
- W3037875189 hasRelatedWork W3037338728 @default.
- W3037875189 hasRelatedWork W3118608800 @default.
- W3037875189 isParatext "false" @default.
- W3037875189 isRetracted "false" @default.
- W3037875189 magId "3037875189" @default.
- W3037875189 workType "article" @default.