Matches in SemOpenAlex for { <https://semopenalex.org/work/W2938693278> ?p ?o ?g. }
- W2938693278 endingPage "26" @default.
- W2938693278 startingPage "1" @default.
- W2938693278 abstract "With the fast development of deep learning (DL), the communication is increasingly a bottleneck for distributed workloads, and a series of optimization works have been done to scale out successfully. Nevertheless, the network behavior has not been investigated much yet. We intend to analyze the network behavior and then carry out some research through network simulation. Under this circumstance, an accurate communication measurement is necessary, as it is an effective way to study the network behavior and the basis for accurate simulation. Therefore, we propose to capture the deep learning communication (DLC) trace to achieve the measurement. To the best of our knowledge, we make the first attempt to capture the communication trace for DL training. In this article, we first provide detailed analyses about the communication mechanism of MXNet, which is a representative framework for distributed DL. Secondly, we define the DLC trace format to describe and record the communication behaviors. Third, we present the implementation of method for trace capturing. Finally, we make some statistics and analyses about the distributed DL training, including communication pattern, overlap ratio between computation and communication, computation overhead, synchronization overhead, update overhead, and so forth. Both the statistics and analyses are based on the trace files captured in a cluster with six machines. On the one hand, our trace files provide a sketch on the DLC, which contributes to understanding the communication details. On the other hand, the captured trace files can be used for figuring out various overheads, as they record the communication behaviors of each node." @default.
- W2938693278 created "2019-04-25" @default.
- W2938693278 creator A5000688713 @default.
- W2938693278 creator A5006729432 @default.
- W2938693278 creator A5012198727 @default.
- W2938693278 creator A5042353509 @default.
- W2938693278 date "2019-04-18" @default.
- W2938693278 modified "2023-10-16" @default.
- W2938693278 title "SketchDLC" @default.
- W2938693278 cites W1916653100 @default.
- W2938693278 cites W1962947981 @default.
- W2938693278 cites W1969805974 @default.
- W2938693278 cites W2048266589 @default.
- W2938693278 cites W2083842231 @default.
- W2938693278 cites W2096826476 @default.
- W2938693278 cites W2097117768 @default.
- W2938693278 cites W2108598243 @default.
- W2938693278 cites W2112796928 @default.
- W2938693278 cites W2121071827 @default.
- W2938693278 cites W2155893237 @default.
- W2938693278 cites W2194775991 @default.
- W2938693278 cites W2540279855 @default.
- W2938693278 cites W2580688187 @default.
- W2938693278 cites W2606722458 @default.
- W2938693278 cites W2613264550 @default.
- W2938693278 cites W2883920103 @default.
- W2938693278 cites W2926543120 @default.
- W2938693278 cites W2949615858 @default.
- W2938693278 cites W4212788319 @default.
- W2938693278 cites W4254672563 @default.
- W2938693278 doi "https://doi.org/10.1145/3312570" @default.
- W2938693278 hasPublicationYear "2019" @default.
- W2938693278 type Work @default.
- W2938693278 sameAs 2938693278 @default.
- W2938693278 citedByCount "7" @default.
- W2938693278 countsByYear W29386932782021 @default.
- W2938693278 countsByYear W29386932782022 @default.
- W2938693278 countsByYear W29386932782023 @default.
- W2938693278 crossrefType "journal-article" @default.
- W2938693278 hasAuthorship W2938693278A5000688713 @default.
- W2938693278 hasAuthorship W2938693278A5006729432 @default.
- W2938693278 hasAuthorship W2938693278A5012198727 @default.
- W2938693278 hasAuthorship W2938693278A5042353509 @default.
- W2938693278 hasBestOaLocation W29386932781 @default.
- W2938693278 hasConcept C101765175 @default.
- W2938693278 hasConcept C108583219 @default.
- W2938693278 hasConcept C111919701 @default.
- W2938693278 hasConcept C119857082 @default.
- W2938693278 hasConcept C120314980 @default.
- W2938693278 hasConcept C127162648 @default.
- W2938693278 hasConcept C127413603 @default.
- W2938693278 hasConcept C138885662 @default.
- W2938693278 hasConcept C149635348 @default.
- W2938693278 hasConcept C154945302 @default.
- W2938693278 hasConcept C2778562939 @default.
- W2938693278 hasConcept C2779960059 @default.
- W2938693278 hasConcept C2780513914 @default.
- W2938693278 hasConcept C31258907 @default.
- W2938693278 hasConcept C41008148 @default.
- W2938693278 hasConcept C41895202 @default.
- W2938693278 hasConcept C62611344 @default.
- W2938693278 hasConcept C66938386 @default.
- W2938693278 hasConcept C75291252 @default.
- W2938693278 hasConceptScore W2938693278C101765175 @default.
- W2938693278 hasConceptScore W2938693278C108583219 @default.
- W2938693278 hasConceptScore W2938693278C111919701 @default.
- W2938693278 hasConceptScore W2938693278C119857082 @default.
- W2938693278 hasConceptScore W2938693278C120314980 @default.
- W2938693278 hasConceptScore W2938693278C127162648 @default.
- W2938693278 hasConceptScore W2938693278C127413603 @default.
- W2938693278 hasConceptScore W2938693278C138885662 @default.
- W2938693278 hasConceptScore W2938693278C149635348 @default.
- W2938693278 hasConceptScore W2938693278C154945302 @default.
- W2938693278 hasConceptScore W2938693278C2778562939 @default.
- W2938693278 hasConceptScore W2938693278C2779960059 @default.
- W2938693278 hasConceptScore W2938693278C2780513914 @default.
- W2938693278 hasConceptScore W2938693278C31258907 @default.
- W2938693278 hasConceptScore W2938693278C41008148 @default.
- W2938693278 hasConceptScore W2938693278C41895202 @default.
- W2938693278 hasConceptScore W2938693278C62611344 @default.
- W2938693278 hasConceptScore W2938693278C66938386 @default.
- W2938693278 hasConceptScore W2938693278C75291252 @default.
- W2938693278 hasIssue "2" @default.
- W2938693278 hasLocation W29386932781 @default.
- W2938693278 hasOpenAccess W2938693278 @default.
- W2938693278 hasPrimaryLocation W29386932781 @default.
- W2938693278 hasRelatedWork W2131630752 @default.
- W2938693278 hasRelatedWork W3014300295 @default.
- W2938693278 hasRelatedWork W3164822677 @default.
- W2938693278 hasRelatedWork W4223943233 @default.
- W2938693278 hasRelatedWork W4225161397 @default.
- W2938693278 hasRelatedWork W4309045103 @default.
- W2938693278 hasRelatedWork W4312200629 @default.
- W2938693278 hasRelatedWork W4360585206 @default.
- W2938693278 hasRelatedWork W4364306694 @default.
- W2938693278 hasRelatedWork W94000989 @default.
- W2938693278 hasVolume "16" @default.
- W2938693278 isParatext "false" @default.