Matches in SemOpenAlex for { <https://semopenalex.org/work/W3091372014> ?p ?o ?g. }
- W3091372014 abstract "As numerous machine learning and other algorithms increase in complexity and data requirements, distributed computing becomes necessary to satisfy the growing computational and storage demands, because it enables parallel execution of smaller tasks that make up a large computing job. However, random fluctuations in task service times lead to straggling tasks with long execution times. Redundancy, in the form of task replication and erasure coding, provides diversity that allows a job to be completed when only a subset of redundant tasks is executed, thus removing the dependency on the straggling tasks. In situations of constrained resources (here a fixed number of parallel servers), increasing redundancy reduces the available resources for parallelism. In this paper, we characterize the diversity vs. parallelism trade-off and identify the optimal strategy, among replication, coding and splitting, which minimizes the expected job completion time. We consider three common service time distributions and establish three models that describe scaling of these distributions with the task size. We find that different distributions with different scaling models operate optimally at different levels of redundancy, and thus may require very different code rates." @default.
- W3091372014 created "2020-10-08" @default.
- W3091372014 creator A5034055788 @default.
- W3091372014 creator A5034577486 @default.
- W3091372014 creator A5080012042 @default.
- W3091372014 date "2020-10-05" @default.
- W3091372014 modified "2023-09-23" @default.
- W3091372014 title "Diversity/Parallelism Trade-off in Distributed Systems with Redundancy" @default.
- W3091372014 cites W108191704 @default.
- W3091372014 cites W1497601926 @default.
- W3091372014 cites W154253821 @default.
- W3091372014 cites W1598866093 @default.
- W3091372014 cites W1646366222 @default.
- W3091372014 cites W1750643891 @default.
- W3091372014 cites W1903497807 @default.
- W3091372014 cites W1975462169 @default.
- W3091372014 cites W1980147176 @default.
- W3091372014 cites W1982063824 @default.
- W3091372014 cites W1983964956 @default.
- W3091372014 cites W2022138967 @default.
- W3091372014 cites W2029718725 @default.
- W3091372014 cites W2043670592 @default.
- W3091372014 cites W2064224609 @default.
- W3091372014 cites W2072936102 @default.
- W3091372014 cites W2080860655 @default.
- W3091372014 cites W2099394118 @default.
- W3091372014 cites W2101204871 @default.
- W3091372014 cites W2107276343 @default.
- W3091372014 cites W2132737349 @default.
- W3091372014 cites W2163961697 @default.
- W3091372014 cites W2168231600 @default.
- W3091372014 cites W2268702383 @default.
- W3091372014 cites W2271840356 @default.
- W3091372014 cites W2278169178 @default.
- W3091372014 cites W2284629249 @default.
- W3091372014 cites W2307033123 @default.
- W3091372014 cites W2316383984 @default.
- W3091372014 cites W2333156538 @default.
- W3091372014 cites W2336650964 @default.
- W3091372014 cites W2343350230 @default.
- W3091372014 cites W2552867920 @default.
- W3091372014 cites W2556205507 @default.
- W3091372014 cites W2588372060 @default.
- W3091372014 cites W2741736887 @default.
- W3091372014 cites W2751625010 @default.
- W3091372014 cites W2757172027 @default.
- W3091372014 cites W2763033695 @default.
- W3091372014 cites W2787490376 @default.
- W3091372014 cites W2791869133 @default.
- W3091372014 cites W2792630208 @default.
- W3091372014 cites W2894591993 @default.
- W3091372014 cites W2922342388 @default.
- W3091372014 cites W2951549931 @default.
- W3091372014 cites W2962850796 @default.
- W3091372014 cites W2962860108 @default.
- W3091372014 cites W2962885409 @default.
- W3091372014 cites W2962904109 @default.
- W3091372014 cites W2962941774 @default.
- W3091372014 cites W2963117124 @default.
- W3091372014 cites W2963120442 @default.
- W3091372014 cites W2963152109 @default.
- W3091372014 cites W2963531643 @default.
- W3091372014 cites W2963706835 @default.
- W3091372014 cites W2963804082 @default.
- W3091372014 cites W2964013285 @default.
- W3091372014 cites W2964078325 @default.
- W3091372014 cites W2964095159 @default.
- W3091372014 cites W2964160151 @default.
- W3091372014 cites W2964229375 @default.
- W3091372014 cites W2964395536 @default.
- W3091372014 cites W2976713597 @default.
- W3091372014 cites W2982519549 @default.
- W3091372014 cites W2992990865 @default.
- W3091372014 cites W3081465783 @default.
- W3091372014 cites W3098226281 @default.
- W3091372014 cites W3146504024 @default.
- W3091372014 cites W3189979102 @default.
- W3091372014 doi "https://doi.org/10.48550/arxiv.2010.02147" @default.
- W3091372014 hasPublicationYear "2020" @default.
- W3091372014 type Work @default.
- W3091372014 sameAs 3091372014 @default.
- W3091372014 citedByCount "5" @default.
- W3091372014 countsByYear W30913720142020 @default.
- W3091372014 countsByYear W30913720142021 @default.
- W3091372014 crossrefType "posted-content" @default.
- W3091372014 hasAuthorship W3091372014A5034055788 @default.
- W3091372014 hasAuthorship W3091372014A5034577486 @default.
- W3091372014 hasAuthorship W3091372014A5080012042 @default.
- W3091372014 hasBestOaLocation W30913720141 @default.
- W3091372014 hasConcept C105795698 @default.
- W3091372014 hasConcept C111919701 @default.
- W3091372014 hasConcept C11413529 @default.
- W3091372014 hasConcept C120314980 @default.
- W3091372014 hasConcept C137529215 @default.
- W3091372014 hasConcept C138101251 @default.
- W3091372014 hasConcept C152124472 @default.
- W3091372014 hasConcept C162324750 @default.
- W3091372014 hasConcept C173608175 @default.
- W3091372014 hasConcept C179518139 @default.
- W3091372014 hasConcept C187736073 @default.