Matches in SemOpenAlex for { <https://semopenalex.org/work/W2770670265> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W2770670265 abstract "Big data workflows comprised of moldable parallel MapReduce programs running on a large number of processors have become a main consumer of energy at data centers. The degree of parallelism of each moldable job in such workflows has a significant impact on the energy efficiency of parallel computing systems, which remains largely unexplored. In this paper, we validate with experimental results the moldable parallel computing model where the dynamic energy consumption of a moldable job increases with the number of parallel tasks. Based on our validation, we construct rigorous cost models and formulate a dynamic scheduling problem of deadline-constrained MapReduce workflows to minimize energy consumption in Hadoop systems. We propose a semi-dynamic online scheduling algorithm based on adaptive task partitioning to reduce dynamic energy consumption while meeting performance requirements from a global perspective, and also design the corresponding system modules for algorithm implementation in Hadoop architecture. The performance superiority of the proposed algorithm in terms of dynamic energy saving and deadline violation is illustrated by extensive simulation results in Hadoop/YARN in comparison with existing algorithms, and the core module of adaptive task partitioning is further validated through real-life workflow implementation and experimental results using the Oozie workflow engine in Hadoop/YARN systems." @default.
- W2770670265 created "2017-12-04" @default.
- W2770670265 creator A5054307870 @default.
- W2770670265 creator A5063576279 @default.
- W2770670265 date "2017-10-01" @default.
- W2770670265 modified "2023-09-23" @default.
- W2770670265 title "Energy-Efficient Dynamic Scheduling of Deadline-Constrained MapReduce Workflows" @default.
- W2770670265 cites W1515595738 @default.
- W2770670265 cites W1545686965 @default.
- W2770670265 cites W1773653770 @default.
- W2770670265 cites W2014438294 @default.
- W2770670265 cites W2020828423 @default.
- W2770670265 cites W2038358279 @default.
- W2770670265 cites W2060042533 @default.
- W2770670265 cites W2099204199 @default.
- W2770670265 cites W2118566694 @default.
- W2770670265 cites W2128612770 @default.
- W2770670265 cites W2130010548 @default.
- W2770670265 cites W2133408093 @default.
- W2770670265 cites W2140509629 @default.
- W2770670265 cites W2150879632 @default.
- W2770670265 cites W2276362660 @default.
- W2770670265 cites W2319104719 @default.
- W2770670265 cites W2417781097 @default.
- W2770670265 cites W2488745305 @default.
- W2770670265 cites W2739642345 @default.
- W2770670265 cites W4300273322 @default.
- W2770670265 cites W98859305 @default.
- W2770670265 doi "https://doi.org/10.1109/escience.2017.18" @default.
- W2770670265 hasPublicationYear "2017" @default.
- W2770670265 type Work @default.
- W2770670265 sameAs 2770670265 @default.
- W2770670265 citedByCount "5" @default.
- W2770670265 countsByYear W27706702652018 @default.
- W2770670265 countsByYear W27706702652019 @default.
- W2770670265 countsByYear W27706702652020 @default.
- W2770670265 countsByYear W27706702652021 @default.
- W2770670265 crossrefType "proceedings-article" @default.
- W2770670265 hasAuthorship W2770670265A5054307870 @default.
- W2770670265 hasAuthorship W2770670265A5063576279 @default.
- W2770670265 hasConcept C107568181 @default.
- W2770670265 hasConcept C111919701 @default.
- W2770670265 hasConcept C120314980 @default.
- W2770670265 hasConcept C126255220 @default.
- W2770670265 hasConcept C173608175 @default.
- W2770670265 hasConcept C177212765 @default.
- W2770670265 hasConcept C206729178 @default.
- W2770670265 hasConcept C2984822820 @default.
- W2770670265 hasConcept C33923547 @default.
- W2770670265 hasConcept C41008148 @default.
- W2770670265 hasConcept C68387754 @default.
- W2770670265 hasConcept C77088390 @default.
- W2770670265 hasConceptScore W2770670265C107568181 @default.
- W2770670265 hasConceptScore W2770670265C111919701 @default.
- W2770670265 hasConceptScore W2770670265C120314980 @default.
- W2770670265 hasConceptScore W2770670265C126255220 @default.
- W2770670265 hasConceptScore W2770670265C173608175 @default.
- W2770670265 hasConceptScore W2770670265C177212765 @default.
- W2770670265 hasConceptScore W2770670265C206729178 @default.
- W2770670265 hasConceptScore W2770670265C2984822820 @default.
- W2770670265 hasConceptScore W2770670265C33923547 @default.
- W2770670265 hasConceptScore W2770670265C41008148 @default.
- W2770670265 hasConceptScore W2770670265C68387754 @default.
- W2770670265 hasConceptScore W2770670265C77088390 @default.
- W2770670265 hasLocation W27706702651 @default.
- W2770670265 hasOpenAccess W2770670265 @default.
- W2770670265 hasPrimaryLocation W27706702651 @default.
- W2770670265 hasRelatedWork W1513409726 @default.
- W2770670265 hasRelatedWork W1565190593 @default.
- W2770670265 hasRelatedWork W1956495302 @default.
- W2770670265 hasRelatedWork W1986789817 @default.
- W2770670265 hasRelatedWork W2017416991 @default.
- W2770670265 hasRelatedWork W2052334484 @default.
- W2770670265 hasRelatedWork W2081526056 @default.
- W2770670265 hasRelatedWork W2125095596 @default.
- W2770670265 hasRelatedWork W2546696010 @default.
- W2770670265 hasRelatedWork W2772328595 @default.
- W2770670265 isParatext "false" @default.
- W2770670265 isRetracted "false" @default.
- W2770670265 magId "2770670265" @default.
- W2770670265 workType "article" @default.