Matches in SemOpenAlex for { <https://semopenalex.org/work/W2498111289> ?p ?o ?g. }
- W2498111289 abstract "Big Data analytics has recently gained increasing popularity as a tool to process large amounts of data on-demand. Spark and Flink are two Apache-hosted data analytics frameworks that facilitate the development of multi-step data pipelines using directly acyclic graph patterns. Making the most out of these frameworks is challenging because efficient executions strongly rely on complex parameter configurations and on an in-depth understanding of the underlying architectural choices. Although extensive research has been devoted to improving and evaluating the performance of such analytics frameworks, most of them benchmark the platforms against Hadoop, as a baseline, a rather unfair comparison considering the fundamentally different design principles. This paper aims to bring some justice in this respect, by directly evaluating the performance of Spark and Flink. Our goal is to identify and explain the impact of the different architectural choices and the parameter configurations on the perceived end-to-end performance. To this end, we develop a methodology for correlating the parameter settings and the operators execution plan with the resource usage. We use this methodology to dissect the performance of Spark and Flink with several representative batch and iterative workloads on up to 100 nodes. Our key finding is that there none of the two framework outperforms the other for all data types, sizes and job patterns. This paper performs a fine characterization of the cases when each framework is superior, and we highlight how this performance correlates to operators, to resource usage and to the specifics of the internal framework design." @default.
- W2498111289 created "2016-08-23" @default.
- W2498111289 creator A5014513972 @default.
- W2498111289 creator A5071296200 @default.
- W2498111289 creator A5077818565 @default.
- W2498111289 creator A5080771130 @default.
- W2498111289 date "2016-09-01" @default.
- W2498111289 modified "2023-10-03" @default.
- W2498111289 title "Spark Versus Flink: Understanding Performance in Big Data Analytics Frameworks" @default.
- W2498111289 cites W1646116162 @default.
- W2498111289 cites W1967841763 @default.
- W2498111289 cites W1976821017 @default.
- W2498111289 cites W2006140865 @default.
- W2498111289 cites W2017855273 @default.
- W2498111289 cites W2022113643 @default.
- W2498111289 cites W2038412523 @default.
- W2498111289 cites W2111364199 @default.
- W2498111289 cites W2121810937 @default.
- W2498111289 cites W2140509629 @default.
- W2498111289 cites W2146620757 @default.
- W2498111289 cites W2190012392 @default.
- W2498111289 cites W2247317079 @default.
- W2498111289 cites W2256629785 @default.
- W2498111289 cites W3103979863 @default.
- W2498111289 cites W2169292922 @default.
- W2498111289 doi "https://doi.org/10.1109/cluster.2016.22" @default.
- W2498111289 hasPublicationYear "2016" @default.
- W2498111289 type Work @default.
- W2498111289 sameAs 2498111289 @default.
- W2498111289 citedByCount "50" @default.
- W2498111289 countsByYear W24981112892016 @default.
- W2498111289 countsByYear W24981112892017 @default.
- W2498111289 countsByYear W24981112892018 @default.
- W2498111289 countsByYear W24981112892019 @default.
- W2498111289 countsByYear W24981112892020 @default.
- W2498111289 countsByYear W24981112892021 @default.
- W2498111289 countsByYear W24981112892022 @default.
- W2498111289 countsByYear W24981112892023 @default.
- W2498111289 crossrefType "proceedings-article" @default.
- W2498111289 hasAuthorship W2498111289A5014513972 @default.
- W2498111289 hasAuthorship W2498111289A5071296200 @default.
- W2498111289 hasAuthorship W2498111289A5077818565 @default.
- W2498111289 hasAuthorship W2498111289A5080771130 @default.
- W2498111289 hasBestOaLocation W24981112892 @default.
- W2498111289 hasConcept C111919701 @default.
- W2498111289 hasConcept C124101348 @default.
- W2498111289 hasConcept C13280743 @default.
- W2498111289 hasConcept C15744967 @default.
- W2498111289 hasConcept C175801342 @default.
- W2498111289 hasConcept C185798385 @default.
- W2498111289 hasConcept C199360897 @default.
- W2498111289 hasConcept C205649164 @default.
- W2498111289 hasConcept C206345919 @default.
- W2498111289 hasConcept C2522767166 @default.
- W2498111289 hasConcept C26517878 @default.
- W2498111289 hasConcept C2780586970 @default.
- W2498111289 hasConcept C2781215313 @default.
- W2498111289 hasConcept C31258907 @default.
- W2498111289 hasConcept C38652104 @default.
- W2498111289 hasConcept C41008148 @default.
- W2498111289 hasConcept C75684735 @default.
- W2498111289 hasConcept C77088390 @default.
- W2498111289 hasConcept C77805123 @default.
- W2498111289 hasConcept C79158427 @default.
- W2498111289 hasConcept C98045186 @default.
- W2498111289 hasConceptScore W2498111289C111919701 @default.
- W2498111289 hasConceptScore W2498111289C124101348 @default.
- W2498111289 hasConceptScore W2498111289C13280743 @default.
- W2498111289 hasConceptScore W2498111289C15744967 @default.
- W2498111289 hasConceptScore W2498111289C175801342 @default.
- W2498111289 hasConceptScore W2498111289C185798385 @default.
- W2498111289 hasConceptScore W2498111289C199360897 @default.
- W2498111289 hasConceptScore W2498111289C205649164 @default.
- W2498111289 hasConceptScore W2498111289C206345919 @default.
- W2498111289 hasConceptScore W2498111289C2522767166 @default.
- W2498111289 hasConceptScore W2498111289C26517878 @default.
- W2498111289 hasConceptScore W2498111289C2780586970 @default.
- W2498111289 hasConceptScore W2498111289C2781215313 @default.
- W2498111289 hasConceptScore W2498111289C31258907 @default.
- W2498111289 hasConceptScore W2498111289C38652104 @default.
- W2498111289 hasConceptScore W2498111289C41008148 @default.
- W2498111289 hasConceptScore W2498111289C75684735 @default.
- W2498111289 hasConceptScore W2498111289C77088390 @default.
- W2498111289 hasConceptScore W2498111289C77805123 @default.
- W2498111289 hasConceptScore W2498111289C79158427 @default.
- W2498111289 hasConceptScore W2498111289C98045186 @default.
- W2498111289 hasLocation W24981112891 @default.
- W2498111289 hasLocation W24981112892 @default.
- W2498111289 hasLocation W24981112893 @default.
- W2498111289 hasLocation W24981112894 @default.
- W2498111289 hasOpenAccess W2498111289 @default.
- W2498111289 hasPrimaryLocation W24981112891 @default.
- W2498111289 hasRelatedWork W2508885301 @default.
- W2498111289 hasRelatedWork W2545366524 @default.
- W2498111289 hasRelatedWork W2752106475 @default.
- W2498111289 hasRelatedWork W2769430831 @default.
- W2498111289 hasRelatedWork W2777139086 @default.
- W2498111289 hasRelatedWork W2929289283 @default.
- W2498111289 hasRelatedWork W3142038251 @default.
- W2498111289 hasRelatedWork W3177086633 @default.