Matches in SemOpenAlex for { <https://semopenalex.org/work/W20402520> ?p ?o ?g. }
- W20402520 abstract "ENERGY EFFICIENT DATA-INTENSIVE COMPUTING WITH MAPREDUCE Thomas S. Wirtz Marquette University, 2013 Power and energy consumption are critical constraints in data center design and operation. In data centers, MapReduce data-intensive applications demand significant resources and energy. Recognizing the importance and urgency of optimizing energy usage of MapReduce applications, this work aims to provide instrumental tools to measure and evaluate MapReduce energy efficiency and techniques to conserve energy without impacting performance. Energy conservation for data-intensive computing requires enabling technology to provide detailed and systemic energy information and to identify in the underlying system hardware and software. To address this need, we present eTune, a fine-grained, scalable energy profiling framework for data-intensive computing on large-scale distributed systems. eTune leverages performance monitoring counters (PMCs) on modern computer components and statistically builds power-performance correlation models. Using learned models, eTune augments direct measurement with a software-based power estimator that runs on compute nodes and reports power at multiple levels including node, core, memory, and disks with high accuracy. Data-intensive computing differs from traditional high performance computing as most execution time is spent in moving data between storage devices, nodes, and components. Since data movements are potential performance and energy bottlenecks, we propose an analysis framework with methods and metrics for evaluating and characterizing costly built-in MapReduce data movements. The revealed data movement energy characteristics can be exploited in system design and resource allocation to improve data-intensive computing energy efficiency. Finally, we present an optimization technique that targets inefficient built-in MapReduce data movements to conserve energy without impacting performance. The optimization technique allocates the optimal number of compute nodes to applications and dynamically schedules processor frequency during its execution based on data movement characteristics. Experimental results show significant energy savings, though improvements depend on both workload characteristics and policies of resource and dynamic voltage and frequency scheduling. As data volume doubles every two years and more data centers are put into production, energy consumption is expected to grow further. We expect these studies provide direction and insight in building more energy efficient data-intensive systems and applications, and the tools and techniques are adopted by other researchers for their energy efficient studies." @default.
- W20402520 created "2016-06-24" @default.
- W20402520 creator A5015389656 @default.
- W20402520 date "2013-01-01" @default.
- W20402520 modified "2023-09-26" @default.
- W20402520 title "Energy Efficient Data-Intensive Computing With Mapreduce" @default.
- W20402520 cites W137603941 @default.
- W20402520 cites W1544262444 @default.
- W20402520 cites W1555915743 @default.
- W20402520 cites W1821730416 @default.
- W20402520 cites W1995354975 @default.
- W20402520 cites W1996438407 @default.
- W20402520 cites W1996975941 @default.
- W20402520 cites W1998252153 @default.
- W20402520 cites W2002072104 @default.
- W20402520 cites W2014371209 @default.
- W20402520 cites W2017751491 @default.
- W20402520 cites W2045350099 @default.
- W20402520 cites W2057087550 @default.
- W20402520 cites W2067051372 @default.
- W20402520 cites W2072004134 @default.
- W20402520 cites W2074697849 @default.
- W20402520 cites W2096125134 @default.
- W20402520 cites W2096893233 @default.
- W20402520 cites W2102727118 @default.
- W20402520 cites W2103593151 @default.
- W20402520 cites W2106932631 @default.
- W20402520 cites W2118651798 @default.
- W20402520 cites W2118955868 @default.
- W20402520 cites W2129162721 @default.
- W20402520 cites W2130010548 @default.
- W20402520 cites W2134807578 @default.
- W20402520 cites W2144293278 @default.
- W20402520 cites W2149212714 @default.
- W20402520 cites W2149813938 @default.
- W20402520 cites W2151587416 @default.
- W20402520 cites W2154399174 @default.
- W20402520 cites W2160804075 @default.
- W20402520 cites W2163291889 @default.
- W20402520 cites W2163449191 @default.
- W20402520 cites W2166716750 @default.
- W20402520 cites W2170958907 @default.
- W20402520 cites W2173213060 @default.
- W20402520 cites W2582743722 @default.
- W20402520 cites W55109682 @default.
- W20402520 cites W68188327 @default.
- W20402520 cites W91277103 @default.
- W20402520 cites W1971879981 @default.
- W20402520 hasPublicationYear "2013" @default.
- W20402520 type Work @default.
- W20402520 sameAs 20402520 @default.
- W20402520 citedByCount "0" @default.
- W20402520 crossrefType "journal-article" @default.
- W20402520 hasAuthorship W20402520A5015389656 @default.
- W20402520 hasConcept C111919701 @default.
- W20402520 hasConcept C119599485 @default.
- W20402520 hasConcept C120314980 @default.
- W20402520 hasConcept C124101348 @default.
- W20402520 hasConcept C127413603 @default.
- W20402520 hasConcept C153740404 @default.
- W20402520 hasConcept C173608175 @default.
- W20402520 hasConcept C187191949 @default.
- W20402520 hasConcept C187691185 @default.
- W20402520 hasConcept C2524010 @default.
- W20402520 hasConcept C2742236 @default.
- W20402520 hasConcept C2777904410 @default.
- W20402520 hasConcept C2780165032 @default.
- W20402520 hasConcept C33923547 @default.
- W20402520 hasConcept C41008148 @default.
- W20402520 hasConcept C48044578 @default.
- W20402520 hasConcept C70429105 @default.
- W20402520 hasConcept C75684735 @default.
- W20402520 hasConcept C76831024 @default.
- W20402520 hasConcept C77088390 @default.
- W20402520 hasConcept C83283714 @default.
- W20402520 hasConceptScore W20402520C111919701 @default.
- W20402520 hasConceptScore W20402520C119599485 @default.
- W20402520 hasConceptScore W20402520C120314980 @default.
- W20402520 hasConceptScore W20402520C124101348 @default.
- W20402520 hasConceptScore W20402520C127413603 @default.
- W20402520 hasConceptScore W20402520C153740404 @default.
- W20402520 hasConceptScore W20402520C173608175 @default.
- W20402520 hasConceptScore W20402520C187191949 @default.
- W20402520 hasConceptScore W20402520C187691185 @default.
- W20402520 hasConceptScore W20402520C2524010 @default.
- W20402520 hasConceptScore W20402520C2742236 @default.
- W20402520 hasConceptScore W20402520C2777904410 @default.
- W20402520 hasConceptScore W20402520C2780165032 @default.
- W20402520 hasConceptScore W20402520C33923547 @default.
- W20402520 hasConceptScore W20402520C41008148 @default.
- W20402520 hasConceptScore W20402520C48044578 @default.
- W20402520 hasConceptScore W20402520C70429105 @default.
- W20402520 hasConceptScore W20402520C75684735 @default.
- W20402520 hasConceptScore W20402520C76831024 @default.
- W20402520 hasConceptScore W20402520C77088390 @default.
- W20402520 hasConceptScore W20402520C83283714 @default.
- W20402520 hasLocation W204025201 @default.
- W20402520 hasOpenAccess W20402520 @default.
- W20402520 hasPrimaryLocation W204025201 @default.
- W20402520 hasRelatedWork W2029390018 @default.