Matches in SemOpenAlex for { <https://semopenalex.org/work/W2039724126> ?p ?o ?g. }
- W2039724126 abstract "MapReduce is a widely accepted framework for addressing big data challenges. Recently, it has also gained broad attention from scientists at the U.S. leadership computing facilities as a promising solution to process gigantic simulation results. However, conventional high-end computing systems are constructed based on the compute-centric paradigm while big data analytics applications prefer a data-centric paradigm such as MapReduce. This work characterizes the performance impact of key differences between compute- and data-centric paradigms and then provides optimizations to enable a dual-purpose HPC system that can efficiently support conventional HPC applications and new data analytics applications. Using a state-of-the-art MapReduce implementation Spark and the Hyperion system at Lawrence Livermore National Laboratory, we have examined the impact of storage architectures, data locality and task scheduling to the memory-resident MapReduce jobs. Based on our characterization and findings of the performance behaviors, we have introduced two optimization techniques, namely Enhanced Load Balancer and Congestion-Aware Task Dispatching, to improve the performance of Spark applications." @default.
- W2039724126 created "2016-06-24" @default.
- W2039724126 creator A5047152293 @default.
- W2039724126 creator A5047853928 @default.
- W2039724126 creator A5070216261 @default.
- W2039724126 creator A5089778019 @default.
- W2039724126 date "2014-05-01" @default.
- W2039724126 modified "2023-09-23" @default.
- W2039724126 title "Characterization and Optimization of Memory-Resident MapReduce on HPC Systems" @default.
- W2039724126 cites W2045717006 @default.
- W2039724126 cites W2071989194 @default.
- W2039724126 cites W2088445131 @default.
- W2039724126 cites W2096125134 @default.
- W2039724126 cites W2100830825 @default.
- W2039724126 cites W2106436364 @default.
- W2039724126 cites W2119738171 @default.
- W2039724126 cites W2139072600 @default.
- W2039724126 cites W2149941839 @default.
- W2039724126 cites W2173213060 @default.
- W2039724126 cites W4235448192 @default.
- W2039724126 doi "https://doi.org/10.1109/ipdps.2014.87" @default.
- W2039724126 hasPublicationYear "2014" @default.
- W2039724126 type Work @default.
- W2039724126 sameAs 2039724126 @default.
- W2039724126 citedByCount "45" @default.
- W2039724126 countsByYear W20397241262014 @default.
- W2039724126 countsByYear W20397241262015 @default.
- W2039724126 countsByYear W20397241262016 @default.
- W2039724126 countsByYear W20397241262017 @default.
- W2039724126 countsByYear W20397241262018 @default.
- W2039724126 countsByYear W20397241262019 @default.
- W2039724126 countsByYear W20397241262020 @default.
- W2039724126 countsByYear W20397241262021 @default.
- W2039724126 crossrefType "proceedings-article" @default.
- W2039724126 hasAuthorship W2039724126A5047152293 @default.
- W2039724126 hasAuthorship W2039724126A5047853928 @default.
- W2039724126 hasAuthorship W2039724126A5070216261 @default.
- W2039724126 hasAuthorship W2039724126A5089778019 @default.
- W2039724126 hasConcept C111919701 @default.
- W2039724126 hasConcept C118524514 @default.
- W2039724126 hasConcept C120314980 @default.
- W2039724126 hasConcept C123593499 @default.
- W2039724126 hasConcept C127413603 @default.
- W2039724126 hasConcept C138885662 @default.
- W2039724126 hasConcept C162324750 @default.
- W2039724126 hasConcept C164120249 @default.
- W2039724126 hasConcept C173608175 @default.
- W2039724126 hasConcept C194222762 @default.
- W2039724126 hasConcept C199360897 @default.
- W2039724126 hasConcept C201995342 @default.
- W2039724126 hasConcept C206729178 @default.
- W2039724126 hasConcept C21547014 @default.
- W2039724126 hasConcept C23123220 @default.
- W2039724126 hasConcept C2522767166 @default.
- W2039724126 hasConcept C26517878 @default.
- W2039724126 hasConcept C2779808786 @default.
- W2039724126 hasConcept C2780451532 @default.
- W2039724126 hasConcept C2781215313 @default.
- W2039724126 hasConcept C41008148 @default.
- W2039724126 hasConcept C41895202 @default.
- W2039724126 hasConcept C75684735 @default.
- W2039724126 hasConcept C79158427 @default.
- W2039724126 hasConcept C83283714 @default.
- W2039724126 hasConcept C97854310 @default.
- W2039724126 hasConcept C98045186 @default.
- W2039724126 hasConceptScore W2039724126C111919701 @default.
- W2039724126 hasConceptScore W2039724126C118524514 @default.
- W2039724126 hasConceptScore W2039724126C120314980 @default.
- W2039724126 hasConceptScore W2039724126C123593499 @default.
- W2039724126 hasConceptScore W2039724126C127413603 @default.
- W2039724126 hasConceptScore W2039724126C138885662 @default.
- W2039724126 hasConceptScore W2039724126C162324750 @default.
- W2039724126 hasConceptScore W2039724126C164120249 @default.
- W2039724126 hasConceptScore W2039724126C173608175 @default.
- W2039724126 hasConceptScore W2039724126C194222762 @default.
- W2039724126 hasConceptScore W2039724126C199360897 @default.
- W2039724126 hasConceptScore W2039724126C201995342 @default.
- W2039724126 hasConceptScore W2039724126C206729178 @default.
- W2039724126 hasConceptScore W2039724126C21547014 @default.
- W2039724126 hasConceptScore W2039724126C23123220 @default.
- W2039724126 hasConceptScore W2039724126C2522767166 @default.
- W2039724126 hasConceptScore W2039724126C26517878 @default.
- W2039724126 hasConceptScore W2039724126C2779808786 @default.
- W2039724126 hasConceptScore W2039724126C2780451532 @default.
- W2039724126 hasConceptScore W2039724126C2781215313 @default.
- W2039724126 hasConceptScore W2039724126C41008148 @default.
- W2039724126 hasConceptScore W2039724126C41895202 @default.
- W2039724126 hasConceptScore W2039724126C75684735 @default.
- W2039724126 hasConceptScore W2039724126C79158427 @default.
- W2039724126 hasConceptScore W2039724126C83283714 @default.
- W2039724126 hasConceptScore W2039724126C97854310 @default.
- W2039724126 hasConceptScore W2039724126C98045186 @default.
- W2039724126 hasLocation W20397241261 @default.
- W2039724126 hasOpenAccess W2039724126 @default.
- W2039724126 hasPrimaryLocation W20397241261 @default.
- W2039724126 hasRelatedWork W1509211761 @default.
- W2039724126 hasRelatedWork W2545366524 @default.
- W2039724126 hasRelatedWork W2546696010 @default.
- W2039724126 hasRelatedWork W2769430831 @default.
- W2039724126 hasRelatedWork W3142038251 @default.