Matches in SemOpenAlex for { <https://semopenalex.org/work/W4299652238> ?p ?o ?g. }
Showing items 1 to 59 of
59
with 100 items per page.
- W4299652238 abstract "The objective of this work was to utilize BigBench [1] as a Big Data benchmark and evaluate and compare two processing engines: MapReduce [2] and Spark [3]. MapReduce is the established engine for processing data on Hadoop. Spark is a popular alternative engine that promises faster processing times than the established MapReduce engine. BigBench was chosen for this comparison because it is the first end-to-end analytics Big Data benchmark and it is currently under public review as TPCx-BB [4]. One of our goals was to evaluate the benchmark by performing various scalability tests and validate that it is able to stress test the processing engines. First, we analyzed the steps necessary to execute the available MapReduce implementation of BigBench [1] on Spark. Then, all the 30 BigBench queries were executed on MapReduce/Hive with different scale factors in order to see how the performance changes with the increase of the data size. Next, the group of HiveQL queries were executed on Spark SQL and compared with their respective Hive runtimes. This report gives a detailed overview on how to setup an experimental Hadoop cluster and execute BigBench on both Hive and Spark SQL. It provides the absolute times for all experiments preformed for different scale factors as well as query results which can be used to validate correct benchmark execution. Additionally, multiple issues and workarounds were encountered and solved during our work. An evaluation of the resource utilization (CPU, memory, disk and network usage) of a subset of representative BigBench queries is presented to illustrate the behavior of the different query groups on both processing engines. Last but not least it is important to mention that larger parts of this report are taken from the master thesis of Max-Georg Beer, entitled Evaluation of BigBench on Apache Spark Compared to MapReduce [5]." @default.
- W4299652238 created "2022-10-02" @default.
- W4299652238 creator A5043336694 @default.
- W4299652238 creator A5083705869 @default.
- W4299652238 date "2015-12-28" @default.
- W4299652238 modified "2023-09-30" @default.
- W4299652238 title "Evaluating Hive and Spark SQL with BigBench" @default.
- W4299652238 doi "https://doi.org/10.48550/arxiv.1512.08417" @default.
- W4299652238 hasPublicationYear "2015" @default.
- W4299652238 type Work @default.
- W4299652238 citedByCount "0" @default.
- W4299652238 crossrefType "posted-content" @default.
- W4299652238 hasAuthorship W4299652238A5043336694 @default.
- W4299652238 hasAuthorship W4299652238A5083705869 @default.
- W4299652238 hasBestOaLocation W42996522381 @default.
- W4299652238 hasConcept C111919701 @default.
- W4299652238 hasConcept C13280743 @default.
- W4299652238 hasConcept C135572916 @default.
- W4299652238 hasConcept C173608175 @default.
- W4299652238 hasConcept C185798385 @default.
- W4299652238 hasConcept C199360897 @default.
- W4299652238 hasConcept C201932085 @default.
- W4299652238 hasConcept C205649164 @default.
- W4299652238 hasConcept C2781215313 @default.
- W4299652238 hasConcept C41008148 @default.
- W4299652238 hasConcept C48044578 @default.
- W4299652238 hasConcept C510870499 @default.
- W4299652238 hasConcept C75684735 @default.
- W4299652238 hasConcept C77088390 @default.
- W4299652238 hasConceptScore W4299652238C111919701 @default.
- W4299652238 hasConceptScore W4299652238C13280743 @default.
- W4299652238 hasConceptScore W4299652238C135572916 @default.
- W4299652238 hasConceptScore W4299652238C173608175 @default.
- W4299652238 hasConceptScore W4299652238C185798385 @default.
- W4299652238 hasConceptScore W4299652238C199360897 @default.
- W4299652238 hasConceptScore W4299652238C201932085 @default.
- W4299652238 hasConceptScore W4299652238C205649164 @default.
- W4299652238 hasConceptScore W4299652238C2781215313 @default.
- W4299652238 hasConceptScore W4299652238C41008148 @default.
- W4299652238 hasConceptScore W4299652238C48044578 @default.
- W4299652238 hasConceptScore W4299652238C510870499 @default.
- W4299652238 hasConceptScore W4299652238C75684735 @default.
- W4299652238 hasConceptScore W4299652238C77088390 @default.
- W4299652238 hasLocation W42996522381 @default.
- W4299652238 hasOpenAccess W4299652238 @default.
- W4299652238 hasPrimaryLocation W42996522381 @default.
- W4299652238 hasRelatedWork W112744582 @default.
- W4299652238 hasRelatedWork W2279919853 @default.
- W4299652238 hasRelatedWork W2539603560 @default.
- W4299652238 hasRelatedWork W2810193297 @default.
- W4299652238 hasRelatedWork W2891888092 @default.
- W4299652238 hasRelatedWork W2972135450 @default.
- W4299652238 hasRelatedWork W3022878348 @default.
- W4299652238 hasRelatedWork W4205887846 @default.
- W4299652238 hasRelatedWork W4299652238 @default.
- W4299652238 hasRelatedWork W2923772254 @default.
- W4299652238 isParatext "false" @default.
- W4299652238 isRetracted "false" @default.
- W4299652238 workType "article" @default.