Matches in SemOpenAlex for { <https://semopenalex.org/work/W3008853396> ?p ?o ?g. }
Showing items 1 to 89 of
89
with 100 items per page.
- W3008853396 abstract "In large-scale enterprise data centers for big data analytics, long batched jobs and short interactive jobs are usually mixed. Hybrid job schedulers, consisting of one centralized scheduler for long jobs and multiple distributed schedulers for short jobs, have become a promising alternative because they can significantly shorten latencies of short jobs via independent and parallelized assignment of short tasks by distributed schedulers and lower chances of head-of-line blocking via a number of performance optimization techniques.However, short jobs are still facing long job latencies under hybrid job schedulers due to workload fluctuation and straggler task problem. In this paper, we propose Eirene to optimize the latency performance of short jobs via two schemes tightly coupled into the general architecture of hybrid job schedulers. Coordinated Cold Data Migration leverages high task waiting time of short jobs under heavily-loaded periods and migrates cold data from disks to local memory for the initial phase of reading input so as to shorten task runtime and queueing time. On the other hand, Scheduler-Aware Task Cloning exploits spare computing resources under lightly-loaded periods and performs proactive task cloning for short jobs to mitigate the straggler problem.We implement a prototype of Eirene based on Eagle, a state-of-the-art hybrid job scheduler. Experimental results show that, under heavy loads, Eirene is able to improve 50-percentile (P50), 75-percentile (P75), 90-percentile (P90) latency performance of short jobs by up to 44.4%, 80.3%, 84.1% respectively compared with Eagle under the Facebook trace with a cluster of 50000 nodes." @default.
- W3008853396 created "2020-03-06" @default.
- W3008853396 creator A5020745360 @default.
- W3008853396 creator A5026526428 @default.
- W3008853396 creator A5048021114 @default.
- W3008853396 date "2019-12-01" @default.
- W3008853396 modified "2023-09-22" @default.
- W3008853396 title "Eirene: Improving Short Job Latency Performance with Coordinated Cold Data Migration and Scheduler-Aware Task Cloning" @default.
- W3008853396 cites W1502383304 @default.
- W3008853396 cites W1579147384 @default.
- W3008853396 cites W1746258828 @default.
- W3008853396 cites W1750643891 @default.
- W3008853396 cites W1861377444 @default.
- W3008853396 cites W1903497807 @default.
- W3008853396 cites W1998509479 @default.
- W3008853396 cites W2028617807 @default.
- W3008853396 cites W2094469165 @default.
- W3008853396 cites W2102849319 @default.
- W3008853396 cites W2104993419 @default.
- W3008853396 cites W2105947650 @default.
- W3008853396 cites W2110104287 @default.
- W3008853396 cites W2129542763 @default.
- W3008853396 cites W2131975293 @default.
- W3008853396 cites W2140509629 @default.
- W3008853396 cites W2141563029 @default.
- W3008853396 cites W2157099238 @default.
- W3008853396 cites W2163291889 @default.
- W3008853396 cites W2163961697 @default.
- W3008853396 cites W2248732043 @default.
- W3008853396 cites W2283208771 @default.
- W3008853396 cites W2475738333 @default.
- W3008853396 cites W2735065300 @default.
- W3008853396 cites W2735413621 @default.
- W3008853396 cites W2807969855 @default.
- W3008853396 cites W2886481383 @default.
- W3008853396 cites W2962864324 @default.
- W3008853396 cites W2971982003 @default.
- W3008853396 doi "https://doi.org/10.1109/bigdata47090.2019.9006575" @default.
- W3008853396 hasPublicationYear "2019" @default.
- W3008853396 type Work @default.
- W3008853396 sameAs 3008853396 @default.
- W3008853396 citedByCount "0" @default.
- W3008853396 crossrefType "proceedings-article" @default.
- W3008853396 hasAuthorship W3008853396A5020745360 @default.
- W3008853396 hasAuthorship W3008853396A5026526428 @default.
- W3008853396 hasAuthorship W3008853396A5048021114 @default.
- W3008853396 hasConcept C111873713 @default.
- W3008853396 hasConcept C111919701 @default.
- W3008853396 hasConcept C120314980 @default.
- W3008853396 hasConcept C127413603 @default.
- W3008853396 hasConcept C160403385 @default.
- W3008853396 hasConcept C171627638 @default.
- W3008853396 hasConcept C206729178 @default.
- W3008853396 hasConcept C21547014 @default.
- W3008853396 hasConcept C2778476105 @default.
- W3008853396 hasConcept C31258907 @default.
- W3008853396 hasConcept C41008148 @default.
- W3008853396 hasConcept C76155785 @default.
- W3008853396 hasConcept C82876162 @default.
- W3008853396 hasConceptScore W3008853396C111873713 @default.
- W3008853396 hasConceptScore W3008853396C111919701 @default.
- W3008853396 hasConceptScore W3008853396C120314980 @default.
- W3008853396 hasConceptScore W3008853396C127413603 @default.
- W3008853396 hasConceptScore W3008853396C160403385 @default.
- W3008853396 hasConceptScore W3008853396C171627638 @default.
- W3008853396 hasConceptScore W3008853396C206729178 @default.
- W3008853396 hasConceptScore W3008853396C21547014 @default.
- W3008853396 hasConceptScore W3008853396C2778476105 @default.
- W3008853396 hasConceptScore W3008853396C31258907 @default.
- W3008853396 hasConceptScore W3008853396C41008148 @default.
- W3008853396 hasConceptScore W3008853396C76155785 @default.
- W3008853396 hasConceptScore W3008853396C82876162 @default.
- W3008853396 hasLocation W30088533961 @default.
- W3008853396 hasOpenAccess W3008853396 @default.
- W3008853396 hasPrimaryLocation W30088533961 @default.
- W3008853396 hasRelatedWork W10015386 @default.
- W3008853396 hasRelatedWork W12413086 @default.
- W3008853396 hasRelatedWork W1266607 @default.
- W3008853396 hasRelatedWork W13626869 @default.
- W3008853396 hasRelatedWork W1987664 @default.
- W3008853396 hasRelatedWork W3127862 @default.
- W3008853396 hasRelatedWork W5148837 @default.
- W3008853396 hasRelatedWork W5402048 @default.
- W3008853396 hasRelatedWork W5980533 @default.
- W3008853396 hasRelatedWork W9251591 @default.
- W3008853396 isParatext "false" @default.
- W3008853396 isRetracted "false" @default.
- W3008853396 magId "3008853396" @default.
- W3008853396 workType "article" @default.