Matches in SemOpenAlex for { <https://semopenalex.org/work/W2781919193> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W2781919193 abstract "Data shuffling between distributed cluster of nodes is one of the critical steps in implementing large-scale learning algorithms. Randomly shuffling the data-set among a cluster of workers allows different nodes to obtain fresh data assignments at each learning epoch. This process has been shown to provide improvements in the learning process. However, the statistical benefits of distributed data shuffling come at the cost of extra communication overhead from the master node to worker nodes, and can act as one of the major bottlenecks in the overall time for computation. There has been significant recent interest in devising approaches to minimize this communication overhead. One approach is to provision for extra storage at the computing nodes. The other emerging approach is to leverage coded communication to minimize the overall communication overhead. The focus of this work is to understand the fundamental trade-off between the amount of storage and the communication overhead for distributed data shuffling. In this work, we first present an information theoretic formulation for the data shuffling problem, accounting for the underlying problem parameters (number of workers, $K$, number of data points, $N$, and the available storage, $S$ per node). We then present an information theoretic lower bound on the communication overhead for data shuffling as a function of these parameters. We next present a novel coded communication scheme and show that the resulting communication overhead of the proposed scheme is within a multiplicative factor of at most $frac{K}{K-1}$ from the information-theoretic lower bound. Furthermore, we present the aligned coded shuffling scheme for some storage values, which achieves the optimal storage vs communication trade-off for $K<5$, and further reduces the maximum multiplicative gap down to $frac{K-frac{1}{3}}{K-1}$, for $Kgeq 5$." @default.
- W2781919193 created "2018-01-12" @default.
- W2781919193 creator A5004316408 @default.
- W2781919193 creator A5041296104 @default.
- W2781919193 date "2018-01-05" @default.
- W2781919193 modified "2023-09-27" @default.
- W2781919193 title "Near Optimal Coded Data Shuffling for Distributed Learning" @default.
- W2781919193 cites W1903497807 @default.
- W2781919193 cites W1968514937 @default.
- W2781919193 cites W1982063824 @default.
- W2781919193 cites W2016559894 @default.
- W2781919193 cites W2085482530 @default.
- W2781919193 cites W2093843984 @default.
- W2781919193 cites W2119738171 @default.
- W2781919193 cites W2130507035 @default.
- W2781919193 cites W2173213060 @default.
- W2781919193 cites W2189465200 @default.
- W2781919193 cites W2236240782 @default.
- W2781919193 cites W2291259925 @default.
- W2781919193 cites W2343350230 @default.
- W2781919193 cites W2412574059 @default.
- W2781919193 cites W2567951755 @default.
- W2781919193 cites W2585382847 @default.
- W2781919193 cites W2588792098 @default.
- W2781919193 cites W2614091483 @default.
- W2781919193 cites W2617565736 @default.
- W2781919193 cites W2617602628 @default.
- W2781919193 cites W2620216356 @default.
- W2781919193 cites W2714205045 @default.
- W2781919193 cites W2733640026 @default.
- W2781919193 cites W2745045892 @default.
- W2781919193 cites W2768581207 @default.
- W2781919193 cites W2949205712 @default.
- W2781919193 cites W2950361119 @default.
- W2781919193 cites W2962825369 @default.
- W2781919193 cites W2963706835 @default.
- W2781919193 cites W2963843031 @default.
- W2781919193 hasPublicationYear "2018" @default.
- W2781919193 type Work @default.
- W2781919193 sameAs 2781919193 @default.
- W2781919193 citedByCount "2" @default.
- W2781919193 countsByYear W27819191932018 @default.
- W2781919193 crossrefType "posted-content" @default.
- W2781919193 hasAuthorship W2781919193A5004316408 @default.
- W2781919193 hasAuthorship W2781919193A5041296104 @default.
- W2781919193 hasConcept C111919701 @default.
- W2781919193 hasConcept C119857082 @default.
- W2781919193 hasConcept C120314980 @default.
- W2781919193 hasConcept C127413603 @default.
- W2781919193 hasConcept C153083717 @default.
- W2781919193 hasConcept C167927819 @default.
- W2781919193 hasConcept C173608175 @default.
- W2781919193 hasConcept C199360897 @default.
- W2781919193 hasConcept C2779960059 @default.
- W2781919193 hasConcept C41008148 @default.
- W2781919193 hasConcept C62611344 @default.
- W2781919193 hasConcept C66938386 @default.
- W2781919193 hasConcept C80444323 @default.
- W2781919193 hasConcept C98045186 @default.
- W2781919193 hasConceptScore W2781919193C111919701 @default.
- W2781919193 hasConceptScore W2781919193C119857082 @default.
- W2781919193 hasConceptScore W2781919193C120314980 @default.
- W2781919193 hasConceptScore W2781919193C127413603 @default.
- W2781919193 hasConceptScore W2781919193C153083717 @default.
- W2781919193 hasConceptScore W2781919193C167927819 @default.
- W2781919193 hasConceptScore W2781919193C173608175 @default.
- W2781919193 hasConceptScore W2781919193C199360897 @default.
- W2781919193 hasConceptScore W2781919193C2779960059 @default.
- W2781919193 hasConceptScore W2781919193C41008148 @default.
- W2781919193 hasConceptScore W2781919193C62611344 @default.
- W2781919193 hasConceptScore W2781919193C66938386 @default.
- W2781919193 hasConceptScore W2781919193C80444323 @default.
- W2781919193 hasConceptScore W2781919193C98045186 @default.
- W2781919193 hasLocation W27819191931 @default.
- W2781919193 hasOpenAccess W2781919193 @default.
- W2781919193 hasPrimaryLocation W27819191931 @default.
- W2781919193 hasRelatedWork W1560383917 @default.
- W2781919193 hasRelatedWork W2047657708 @default.
- W2781919193 hasRelatedWork W2118187651 @default.
- W2781919193 hasRelatedWork W2139753091 @default.
- W2781919193 hasRelatedWork W2529355922 @default.
- W2781919193 hasRelatedWork W2621150082 @default.
- W2781919193 hasRelatedWork W2766867902 @default.
- W2781919193 hasRelatedWork W2784739900 @default.
- W2781919193 hasRelatedWork W2786589296 @default.
- W2781919193 hasRelatedWork W2878002416 @default.
- W2781919193 hasRelatedWork W2886151725 @default.
- W2781919193 hasRelatedWork W2887830627 @default.
- W2781919193 hasRelatedWork W2952455455 @default.
- W2781919193 hasRelatedWork W2962820419 @default.
- W2781919193 hasRelatedWork W2964021234 @default.
- W2781919193 hasRelatedWork W2970895312 @default.
- W2781919193 hasRelatedWork W3081034653 @default.
- W2781919193 hasRelatedWork W3093839600 @default.
- W2781919193 hasRelatedWork W3104312721 @default.
- W2781919193 hasRelatedWork W2963565831 @default.
- W2781919193 isParatext "false" @default.
- W2781919193 isRetracted "false" @default.
- W2781919193 magId "2781919193" @default.
- W2781919193 workType "article" @default.