Matches in SemOpenAlex for { <https://semopenalex.org/work/W2190012392> ?p ?o ?g. }
- W2190012392 endingPage "2121" @default.
- W2190012392 startingPage "2110" @default.
- W2190012392 abstract "MapReduce and Spark are two very popular open source cluster computing frameworks for large scale data analytics. These frameworks hide the complexity of task parallelism and fault-tolerance, by exposing a simple programming API to users. In this paper, we evaluate the major architectural components in MapReduce and Spark frameworks including: shuffle, execution model, and caching, by using a set of important analytic workloads. To conduct a detailed analysis, we developed two profiling tools: (1) We correlate the task execution plan with the resource utilization for both MapReduce and Spark, and visually present this correlation; (2) We provide a break-down of the task execution time for in-depth analysis. Through detailed experiments, we quantify the performance differences between MapReduce and Spark. Furthermore, we attribute these performance differences to different components which are architected differently in the two frameworks. We further expose the source of these performance differences by using a set of micro-benchmark experiments. Overall, our experiments show that Spark is about 2.5x, 5x, and 5x faster than MapReduce, for Word Count, k-means, and PageRank, respectively. The main causes of these speedups are the efficiency of the hash-based aggregation component for combine, as well as reduced CPU and disk overheads due to RDD caching in Spark. An exception to this is the Sort workload, for which MapReduce is 2x faster than Spark. We show that MapReduce's execution model is more efficient for shuffling data than Spark, thus making Sort run faster on MapReduce." @default.
- W2190012392 created "2016-06-24" @default.
- W2190012392 creator A5000442684 @default.
- W2190012392 creator A5013038112 @default.
- W2190012392 creator A5025849211 @default.
- W2190012392 creator A5032253873 @default.
- W2190012392 creator A5036119025 @default.
- W2190012392 creator A5070638387 @default.
- W2190012392 creator A5076440257 @default.
- W2190012392 date "2015-09-01" @default.
- W2190012392 modified "2023-10-09" @default.
- W2190012392 title "Clash of the titans" @default.
- W2190012392 cites W2038157364 @default.
- W2190012392 cites W2077738892 @default.
- W2190012392 cites W2105947650 @default.
- W2190012392 cites W2115022330 @default.
- W2190012392 cites W2154983209 @default.
- W2190012392 cites W2155072926 @default.
- W2190012392 cites W2170616854 @default.
- W2190012392 cites W2173213060 @default.
- W2190012392 cites W2187341577 @default.
- W2190012392 doi "https://doi.org/10.14778/2831360.2831365" @default.
- W2190012392 hasPublicationYear "2015" @default.
- W2190012392 type Work @default.
- W2190012392 sameAs 2190012392 @default.
- W2190012392 citedByCount "177" @default.
- W2190012392 countsByYear W21900123922014 @default.
- W2190012392 countsByYear W21900123922015 @default.
- W2190012392 countsByYear W21900123922016 @default.
- W2190012392 countsByYear W21900123922017 @default.
- W2190012392 countsByYear W21900123922018 @default.
- W2190012392 countsByYear W21900123922019 @default.
- W2190012392 countsByYear W21900123922020 @default.
- W2190012392 countsByYear W21900123922021 @default.
- W2190012392 countsByYear W21900123922022 @default.
- W2190012392 countsByYear W21900123922023 @default.
- W2190012392 crossrefType "journal-article" @default.
- W2190012392 hasAuthorship W2190012392A5000442684 @default.
- W2190012392 hasAuthorship W2190012392A5013038112 @default.
- W2190012392 hasAuthorship W2190012392A5025849211 @default.
- W2190012392 hasAuthorship W2190012392A5032253873 @default.
- W2190012392 hasAuthorship W2190012392A5036119025 @default.
- W2190012392 hasAuthorship W2190012392A5070638387 @default.
- W2190012392 hasAuthorship W2190012392A5076440257 @default.
- W2190012392 hasConcept C111919701 @default.
- W2190012392 hasConcept C120314980 @default.
- W2190012392 hasConcept C13280743 @default.
- W2190012392 hasConcept C162324750 @default.
- W2190012392 hasConcept C167927819 @default.
- W2190012392 hasConcept C173608175 @default.
- W2190012392 hasConcept C185798385 @default.
- W2190012392 hasConcept C187191949 @default.
- W2190012392 hasConcept C187736073 @default.
- W2190012392 hasConcept C199360897 @default.
- W2190012392 hasConcept C205649164 @default.
- W2190012392 hasConcept C2776834041 @default.
- W2190012392 hasConcept C2780451532 @default.
- W2190012392 hasConcept C2781215313 @default.
- W2190012392 hasConcept C34165917 @default.
- W2190012392 hasConcept C41008148 @default.
- W2190012392 hasConcept C75684735 @default.
- W2190012392 hasConcept C77088390 @default.
- W2190012392 hasConcept C88548561 @default.
- W2190012392 hasConceptScore W2190012392C111919701 @default.
- W2190012392 hasConceptScore W2190012392C120314980 @default.
- W2190012392 hasConceptScore W2190012392C13280743 @default.
- W2190012392 hasConceptScore W2190012392C162324750 @default.
- W2190012392 hasConceptScore W2190012392C167927819 @default.
- W2190012392 hasConceptScore W2190012392C173608175 @default.
- W2190012392 hasConceptScore W2190012392C185798385 @default.
- W2190012392 hasConceptScore W2190012392C187191949 @default.
- W2190012392 hasConceptScore W2190012392C187736073 @default.
- W2190012392 hasConceptScore W2190012392C199360897 @default.
- W2190012392 hasConceptScore W2190012392C205649164 @default.
- W2190012392 hasConceptScore W2190012392C2776834041 @default.
- W2190012392 hasConceptScore W2190012392C2780451532 @default.
- W2190012392 hasConceptScore W2190012392C2781215313 @default.
- W2190012392 hasConceptScore W2190012392C34165917 @default.
- W2190012392 hasConceptScore W2190012392C41008148 @default.
- W2190012392 hasConceptScore W2190012392C75684735 @default.
- W2190012392 hasConceptScore W2190012392C77088390 @default.
- W2190012392 hasConceptScore W2190012392C88548561 @default.
- W2190012392 hasIssue "13" @default.
- W2190012392 hasLocation W21900123921 @default.
- W2190012392 hasOpenAccess W2190012392 @default.
- W2190012392 hasPrimaryLocation W21900123921 @default.
- W2190012392 hasRelatedWork W2117014006 @default.
- W2190012392 hasRelatedWork W2190012392 @default.
- W2190012392 hasRelatedWork W2258180570 @default.
- W2190012392 hasRelatedWork W2370911386 @default.
- W2190012392 hasRelatedWork W2586475558 @default.
- W2190012392 hasRelatedWork W2771136647 @default.
- W2190012392 hasRelatedWork W2785532068 @default.
- W2190012392 hasRelatedWork W3041531047 @default.
- W2190012392 hasRelatedWork W4237927338 @default.
- W2190012392 hasRelatedWork W4239886304 @default.
- W2190012392 hasVolume "8" @default.
- W2190012392 isParatext "false" @default.