Matches in SemOpenAlex for { <https://semopenalex.org/work/W1908504899> ?p ?o ?g. }
Showing items 1 to 99 of
99
with 100 items per page.
- W1908504899 abstract "MapReduce has been widely adopted as a programming model to process big data. However, parallel jobs in MapReduce are prone to be plagued by stragglers caused by non-local tasks for two reasons: first, system logs from production clusters show that a non-local task can be two times slower than a local task, second, a job's completion time is bottlenecked by its slowest parallel tasks. As a result, even one single non-local task can become the straggler of the whole job, causing significant delay of the whole job. In this paper, we propose to alleviate this problem by proactively prefetching input data for non-local tasks. However, performing such prefetching efficiently in MapReduce is difficult, because it requires both application-level information to generate accurate prefetching requests at runtime, and an appropriate network flow scheduling mechanism to guarantee the timeliness of prefetching flows. To address these challenges, we design and implement FlexFetch, which 1) leverages a novel mechanism called speculative scheduling to accurately generate prefetching flows, %2) explictly allocates network resources to prefetching flows according to their deadlines. 2) explicitly allocates network resources to prefetching flows using a criticalty-aware deadline-driven flow scheduling algorithm. We evaluate FlexFetch through both testbed experiments and large-scale simulations using production workloads. The results show that FlexFetch reduces the completion time by 41.8% for small jobs and 26.8% on average, compared with the default MapReduce implementation in Hadoop." @default.
- W1908504899 created "2016-06-24" @default.
- W1908504899 creator A5015582676 @default.
- W1908504899 creator A5022526821 @default.
- W1908504899 creator A5026062552 @default.
- W1908504899 creator A5055998584 @default.
- W1908504899 creator A5075677046 @default.
- W1908504899 date "2015-09-01" @default.
- W1908504899 modified "2023-09-26" @default.
- W1908504899 title "Taming Non-local Stragglers Using Efficient Prefetching in MapReduce" @default.
- W1908504899 cites W119149194 @default.
- W1908504899 cites W1540207844 @default.
- W1908504899 cites W1579147384 @default.
- W1908504899 cites W1861377444 @default.
- W1908504899 cites W1979444789 @default.
- W1908504899 cites W2022678927 @default.
- W1908504899 cites W2049482525 @default.
- W1908504899 cites W2096125134 @default.
- W1908504899 cites W2100830825 @default.
- W1908504899 cites W2122370965 @default.
- W1908504899 cites W2131975293 @default.
- W1908504899 cites W2140509629 @default.
- W1908504899 cites W2147118406 @default.
- W1908504899 cites W2157099238 @default.
- W1908504899 cites W2161995137 @default.
- W1908504899 cites W2173213060 @default.
- W1908504899 cites W69713013 @default.
- W1908504899 doi "https://doi.org/10.1109/cluster.2015.16" @default.
- W1908504899 hasPublicationYear "2015" @default.
- W1908504899 type Work @default.
- W1908504899 sameAs 1908504899 @default.
- W1908504899 citedByCount "2" @default.
- W1908504899 countsByYear W19085048992019 @default.
- W1908504899 countsByYear W19085048992020 @default.
- W1908504899 crossrefType "proceedings-article" @default.
- W1908504899 hasAuthorship W1908504899A5015582676 @default.
- W1908504899 hasAuthorship W1908504899A5022526821 @default.
- W1908504899 hasAuthorship W1908504899A5026062552 @default.
- W1908504899 hasAuthorship W1908504899A5055998584 @default.
- W1908504899 hasAuthorship W1908504899A5075677046 @default.
- W1908504899 hasConcept C111919701 @default.
- W1908504899 hasConcept C115537543 @default.
- W1908504899 hasConcept C120314980 @default.
- W1908504899 hasConcept C133588205 @default.
- W1908504899 hasConcept C162324750 @default.
- W1908504899 hasConcept C173608175 @default.
- W1908504899 hasConcept C187736073 @default.
- W1908504899 hasConcept C206729178 @default.
- W1908504899 hasConcept C21547014 @default.
- W1908504899 hasConcept C2780451532 @default.
- W1908504899 hasConcept C2989134064 @default.
- W1908504899 hasConcept C31258907 @default.
- W1908504899 hasConcept C31395832 @default.
- W1908504899 hasConcept C41008148 @default.
- W1908504899 hasConcept C75684735 @default.
- W1908504899 hasConcept C98045186 @default.
- W1908504899 hasConceptScore W1908504899C111919701 @default.
- W1908504899 hasConceptScore W1908504899C115537543 @default.
- W1908504899 hasConceptScore W1908504899C120314980 @default.
- W1908504899 hasConceptScore W1908504899C133588205 @default.
- W1908504899 hasConceptScore W1908504899C162324750 @default.
- W1908504899 hasConceptScore W1908504899C173608175 @default.
- W1908504899 hasConceptScore W1908504899C187736073 @default.
- W1908504899 hasConceptScore W1908504899C206729178 @default.
- W1908504899 hasConceptScore W1908504899C21547014 @default.
- W1908504899 hasConceptScore W1908504899C2780451532 @default.
- W1908504899 hasConceptScore W1908504899C2989134064 @default.
- W1908504899 hasConceptScore W1908504899C31258907 @default.
- W1908504899 hasConceptScore W1908504899C31395832 @default.
- W1908504899 hasConceptScore W1908504899C41008148 @default.
- W1908504899 hasConceptScore W1908504899C75684735 @default.
- W1908504899 hasConceptScore W1908504899C98045186 @default.
- W1908504899 hasLocation W19085048991 @default.
- W1908504899 hasOpenAccess W1908504899 @default.
- W1908504899 hasPrimaryLocation W19085048991 @default.
- W1908504899 hasRelatedWork W126407280 @default.
- W1908504899 hasRelatedWork W185167974 @default.
- W1908504899 hasRelatedWork W2006056554 @default.
- W1908504899 hasRelatedWork W2008585803 @default.
- W1908504899 hasRelatedWork W2008607837 @default.
- W1908504899 hasRelatedWork W2039256651 @default.
- W1908504899 hasRelatedWork W2039615371 @default.
- W1908504899 hasRelatedWork W2041958520 @default.
- W1908504899 hasRelatedWork W2057063820 @default.
- W1908504899 hasRelatedWork W2072664012 @default.
- W1908504899 hasRelatedWork W2084318159 @default.
- W1908504899 hasRelatedWork W2085797995 @default.
- W1908504899 hasRelatedWork W2092846217 @default.
- W1908504899 hasRelatedWork W2125754690 @default.
- W1908504899 hasRelatedWork W2133828085 @default.
- W1908504899 hasRelatedWork W2418529204 @default.
- W1908504899 hasRelatedWork W2563325619 @default.
- W1908504899 hasRelatedWork W2783721313 @default.
- W1908504899 hasRelatedWork W2795316290 @default.
- W1908504899 hasRelatedWork W3034553598 @default.
- W1908504899 isParatext "false" @default.
- W1908504899 isRetracted "false" @default.
- W1908504899 magId "1908504899" @default.
- W1908504899 workType "article" @default.