Matches in SemOpenAlex for { <https://semopenalex.org/work/W2010695522> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W2010695522 abstract "The specific choice of workload task schedulers for Hadoop MapReduce applications can have a dramatic effect on job workload latency. The Hadoop Fair Scheduler (FairS) assigns resources to jobs such that all jobs get, on average, an equal share of resources over time. Thus, it addresses the problem with a FIFO scheduler when short jobs have to wait for long running jobs to complete. We show that even for the FairS, jobs are still forced to wait significantly when the MapReduce system assigns equal sharing of resources due to dependencies between Map, Shuffle, Sort, Reduce phases. We propose a Hybrid Scheduler (HybS) algorithm based on dynamic priority in order to reduce the latency for variable length concurrent jobs, while maintaining data locality. The dynamic priorities can accommodate multiple task lengths, job sizes, and job waiting times by applying a greedy fractional knapsack algorithm for job task processor assignment. The estimated runtime of Map and Reduce tasks are provided to the HybS dynamic priorities from the historical Hadoop log files. In addition to dynamic priority, we implement a reordering of task processor assignment to account for data availability to automatically maintain the benefits of data locality in this environment. We evaluate our approach by running concurrent workloads consisting of the Word-count and Terasort benchmarks, and a satellite scientific data processing workload and developing a simulator. Our evaluation shows the HybS system improves the average response time for the workloads approximately 2.1x faster over the Hadoop FairS with a standard deviation of 1.4x." @default.
- W2010695522 created "2016-06-24" @default.
- W2010695522 creator A5004628313 @default.
- W2010695522 creator A5011098359 @default.
- W2010695522 creator A5023235306 @default.
- W2010695522 creator A5039834481 @default.
- W2010695522 creator A5051496784 @default.
- W2010695522 date "2012-11-01" @default.
- W2010695522 modified "2023-10-14" @default.
- W2010695522 title "A Hybrid Scheduling Algorithm for Data Intensive Workloads in a MapReduce Environment" @default.
- W2010695522 cites W1523319063 @default.
- W2010695522 cites W1531403850 @default.
- W2010695522 cites W2018506220 @default.
- W2010695522 cites W2026575055 @default.
- W2010695522 cites W2044981984 @default.
- W2010695522 cites W2094806030 @default.
- W2010695522 cites W2096125134 @default.
- W2010695522 cites W2113718594 @default.
- W2010695522 cites W2133990480 @default.
- W2010695522 cites W2138440835 @default.
- W2010695522 doi "https://doi.org/10.1109/ucc.2012.32" @default.
- W2010695522 hasPublicationYear "2012" @default.
- W2010695522 type Work @default.
- W2010695522 sameAs 2010695522 @default.
- W2010695522 citedByCount "28" @default.
- W2010695522 countsByYear W20106955222013 @default.
- W2010695522 countsByYear W20106955222014 @default.
- W2010695522 countsByYear W20106955222015 @default.
- W2010695522 countsByYear W20106955222017 @default.
- W2010695522 countsByYear W20106955222018 @default.
- W2010695522 countsByYear W20106955222019 @default.
- W2010695522 countsByYear W20106955222020 @default.
- W2010695522 countsByYear W20106955222021 @default.
- W2010695522 countsByYear W20106955222022 @default.
- W2010695522 crossrefType "proceedings-article" @default.
- W2010695522 hasAuthorship W2010695522A5004628313 @default.
- W2010695522 hasAuthorship W2010695522A5011098359 @default.
- W2010695522 hasAuthorship W2010695522A5023235306 @default.
- W2010695522 hasAuthorship W2010695522A5039834481 @default.
- W2010695522 hasAuthorship W2010695522A5051496784 @default.
- W2010695522 hasConcept C111919701 @default.
- W2010695522 hasConcept C120314980 @default.
- W2010695522 hasConcept C138885662 @default.
- W2010695522 hasConcept C162324750 @default.
- W2010695522 hasConcept C173608175 @default.
- W2010695522 hasConcept C187736073 @default.
- W2010695522 hasConcept C206729178 @default.
- W2010695522 hasConcept C21547014 @default.
- W2010695522 hasConcept C2777145635 @default.
- W2010695522 hasConcept C2778476105 @default.
- W2010695522 hasConcept C2779808786 @default.
- W2010695522 hasConcept C2780451532 @default.
- W2010695522 hasConcept C41008148 @default.
- W2010695522 hasConcept C41895202 @default.
- W2010695522 hasConcept C48721391 @default.
- W2010695522 hasConcept C76155785 @default.
- W2010695522 hasConcept C82876162 @default.
- W2010695522 hasConceptScore W2010695522C111919701 @default.
- W2010695522 hasConceptScore W2010695522C120314980 @default.
- W2010695522 hasConceptScore W2010695522C138885662 @default.
- W2010695522 hasConceptScore W2010695522C162324750 @default.
- W2010695522 hasConceptScore W2010695522C173608175 @default.
- W2010695522 hasConceptScore W2010695522C187736073 @default.
- W2010695522 hasConceptScore W2010695522C206729178 @default.
- W2010695522 hasConceptScore W2010695522C21547014 @default.
- W2010695522 hasConceptScore W2010695522C2777145635 @default.
- W2010695522 hasConceptScore W2010695522C2778476105 @default.
- W2010695522 hasConceptScore W2010695522C2779808786 @default.
- W2010695522 hasConceptScore W2010695522C2780451532 @default.
- W2010695522 hasConceptScore W2010695522C41008148 @default.
- W2010695522 hasConceptScore W2010695522C41895202 @default.
- W2010695522 hasConceptScore W2010695522C48721391 @default.
- W2010695522 hasConceptScore W2010695522C76155785 @default.
- W2010695522 hasConceptScore W2010695522C82876162 @default.
- W2010695522 hasLocation W20106955221 @default.
- W2010695522 hasOpenAccess W2010695522 @default.
- W2010695522 hasPrimaryLocation W20106955221 @default.
- W2010695522 hasRelatedWork W2015441043 @default.
- W2010695522 hasRelatedWork W2020531283 @default.
- W2010695522 hasRelatedWork W2058492552 @default.
- W2010695522 hasRelatedWork W2148933941 @default.
- W2010695522 hasRelatedWork W2168288612 @default.
- W2010695522 hasRelatedWork W2322861814 @default.
- W2010695522 hasRelatedWork W2485390638 @default.
- W2010695522 hasRelatedWork W2626729922 @default.
- W2010695522 hasRelatedWork W2945758745 @default.
- W2010695522 hasRelatedWork W3145739807 @default.
- W2010695522 isParatext "false" @default.
- W2010695522 isRetracted "false" @default.
- W2010695522 magId "2010695522" @default.
- W2010695522 workType "article" @default.