Matches in SemOpenAlex for { <https://semopenalex.org/work/W1978150957> ?p ?o ?g. }
- W1978150957 abstract "MapReduce has been adopted widely in both academia and industry to run large-scale data parallel applications. In MapReduce, each slave node hosts a number of task slots to which tasks can be assigned. So they limit the maximum number of tasks that can execute concurrently on each node. When all task slots of a node are not used, the resources “reserved” for idle slots are unutilized. To improve resource utilization, we propose resource stealing to enable running tasks to steal resources reserved for idle slots and give them back proportionally whenever new tasks are assigned. Resource stealing makes the otherwise wasted resources get fully utilized without interfering with normal job scheduling. MapReduce uses speculative execution to improve fault tolerance. Current Hadoop implementation decides whether to run speculative tasks based on the progress rates of running tasks, which does not take into consideration the absolute progress of each task. We propose Benefit Aware Speculative Execution which evaluates the potential benefit of speculative tasks and eliminates unnecessary runs. We implement the proposed algorithms in Hadoop, and our experiments show that our algorithms can significantly shorten job execution time and reduce the number of non-beneficial speculative tasks." @default.
- W1978150957 created "2016-06-24" @default.
- W1978150957 creator A5052329105 @default.
- W1978150957 creator A5059904315 @default.
- W1978150957 creator A5077273334 @default.
- W1978150957 creator A5091834117 @default.
- W1978150957 date "2012-09-01" @default.
- W1978150957 modified "2023-09-22" @default.
- W1978150957 title "Improving Resource Utilization in MapReduce" @default.
- W1978150957 cites W1976860187 @default.
- W1978150957 cites W2068448872 @default.
- W1978150957 cites W2088222724 @default.
- W1978150957 cites W2095536701 @default.
- W1978150957 cites W2096125134 @default.
- W1978150957 cites W2100854666 @default.
- W1978150957 cites W2107351313 @default.
- W1978150957 cites W2112168774 @default.
- W1978150957 cites W2114303224 @default.
- W1978150957 cites W2117466692 @default.
- W1978150957 cites W2132353061 @default.
- W1978150957 cites W2133964524 @default.
- W1978150957 cites W2134807578 @default.
- W1978150957 cites W2147865600 @default.
- W1978150957 cites W2165606466 @default.
- W1978150957 cites W4239429564 @default.
- W1978150957 doi "https://doi.org/10.1109/cluster.2012.69" @default.
- W1978150957 hasPublicationYear "2012" @default.
- W1978150957 type Work @default.
- W1978150957 sameAs 1978150957 @default.
- W1978150957 citedByCount "25" @default.
- W1978150957 countsByYear W19781509572012 @default.
- W1978150957 countsByYear W19781509572013 @default.
- W1978150957 countsByYear W19781509572014 @default.
- W1978150957 countsByYear W19781509572015 @default.
- W1978150957 countsByYear W19781509572016 @default.
- W1978150957 countsByYear W19781509572017 @default.
- W1978150957 countsByYear W19781509572018 @default.
- W1978150957 countsByYear W19781509572019 @default.
- W1978150957 countsByYear W19781509572020 @default.
- W1978150957 countsByYear W19781509572021 @default.
- W1978150957 countsByYear W19781509572022 @default.
- W1978150957 crossrefType "proceedings-article" @default.
- W1978150957 hasAuthorship W1978150957A5052329105 @default.
- W1978150957 hasAuthorship W1978150957A5059904315 @default.
- W1978150957 hasAuthorship W1978150957A5077273334 @default.
- W1978150957 hasAuthorship W1978150957A5091834117 @default.
- W1978150957 hasConcept C111919701 @default.
- W1978150957 hasConcept C120314980 @default.
- W1978150957 hasConcept C127413603 @default.
- W1978150957 hasConcept C141331961 @default.
- W1978150957 hasConcept C162324750 @default.
- W1978150957 hasConcept C16320812 @default.
- W1978150957 hasConcept C173608175 @default.
- W1978150957 hasConcept C187736073 @default.
- W1978150957 hasConcept C206345919 @default.
- W1978150957 hasConcept C206729178 @default.
- W1978150957 hasConcept C21547014 @default.
- W1978150957 hasConcept C2780451532 @default.
- W1978150957 hasConcept C2989134064 @default.
- W1978150957 hasConcept C31258907 @default.
- W1978150957 hasConcept C41008148 @default.
- W1978150957 hasConcept C62611344 @default.
- W1978150957 hasConcept C63540848 @default.
- W1978150957 hasConcept C66938386 @default.
- W1978150957 hasConcept C75684735 @default.
- W1978150957 hasConceptScore W1978150957C111919701 @default.
- W1978150957 hasConceptScore W1978150957C120314980 @default.
- W1978150957 hasConceptScore W1978150957C127413603 @default.
- W1978150957 hasConceptScore W1978150957C141331961 @default.
- W1978150957 hasConceptScore W1978150957C162324750 @default.
- W1978150957 hasConceptScore W1978150957C16320812 @default.
- W1978150957 hasConceptScore W1978150957C173608175 @default.
- W1978150957 hasConceptScore W1978150957C187736073 @default.
- W1978150957 hasConceptScore W1978150957C206345919 @default.
- W1978150957 hasConceptScore W1978150957C206729178 @default.
- W1978150957 hasConceptScore W1978150957C21547014 @default.
- W1978150957 hasConceptScore W1978150957C2780451532 @default.
- W1978150957 hasConceptScore W1978150957C2989134064 @default.
- W1978150957 hasConceptScore W1978150957C31258907 @default.
- W1978150957 hasConceptScore W1978150957C41008148 @default.
- W1978150957 hasConceptScore W1978150957C62611344 @default.
- W1978150957 hasConceptScore W1978150957C63540848 @default.
- W1978150957 hasConceptScore W1978150957C66938386 @default.
- W1978150957 hasConceptScore W1978150957C75684735 @default.
- W1978150957 hasLocation W19781509571 @default.
- W1978150957 hasOpenAccess W1978150957 @default.
- W1978150957 hasPrimaryLocation W19781509571 @default.
- W1978150957 hasRelatedWork W1485627940 @default.
- W1978150957 hasRelatedWork W1827686975 @default.
- W1978150957 hasRelatedWork W2017416991 @default.
- W1978150957 hasRelatedWork W2070479980 @default.
- W1978150957 hasRelatedWork W2152423273 @default.
- W1978150957 hasRelatedWork W2160425906 @default.
- W1978150957 hasRelatedWork W2169451958 @default.
- W1978150957 hasRelatedWork W2542083118 @default.
- W1978150957 hasRelatedWork W4237119828 @default.
- W1978150957 hasRelatedWork W1445870236 @default.
- W1978150957 isParatext "false" @default.
- W1978150957 isRetracted "false" @default.
- W1978150957 magId "1978150957" @default.