Matches in SemOpenAlex for { <https://semopenalex.org/work/W4226280650> ?p ?o ?g. }
Showing items 1 to 95 of
95
with 100 items per page.
- W4226280650 endingPage "885" @default.
- W4226280650 startingPage "872" @default.
- W4226280650 abstract "Apache Spark is a widely deployed big data analytics framework that offers such attractive features as resiliency, load-balancing, and a rich ecosystem. However, there is still plenty of room for improvement in its performance. Although a data-parallel system in a native programming language significantly improves performance, it may require re-implementing many functionalities of Spark to become a full-featured system. It is desirable for native big data systems to just write a compute engine in native languages to ensure high efficiency, and reuse other mature features provided by Spark rather than re-implement everything. But the interaction between the JVM and the native world risks becoming a bottleneck. This paper proposes Chukonu, a native big data framework that re-uses critical big data features provided by Spark. Owing to our novel DAG-splitting approach, the potential Spark integration overhead is alleviated, and its even outperforms existing pure native big data frameworks. Chukonu splits DAG programs into run-time parts and compile-time parts: The run-time parts are delegated to Spark to offload the complexities due to feature implementations. The compile-time parts are natively compiled. We propose a series of optimization techniques to be applied to the compile-time parts, such as operator fusion, vectorization, and compaction, to significantly reduce the Spark integration overhead. The results of evaluation show that Chukonu has a speedup of up to 71.58X (geometric mean 6.09X) over Apache Spark, and up to 7.20X (geometric mean 2.30X) over pure-native frameworks on six commonly-used big data applications. By translating the physical plan produced by SparkSQL into Chukonu programs, Chukonu accelerates Spark-SQL's TPC-DS performance by 2.29X." @default.
- W4226280650 created "2022-05-05" @default.
- W4226280650 creator A5002716694 @default.
- W4226280650 creator A5022309774 @default.
- W4226280650 creator A5025808877 @default.
- W4226280650 creator A5036015561 @default.
- W4226280650 creator A5039766485 @default.
- W4226280650 creator A5066504632 @default.
- W4226280650 creator A5069169048 @default.
- W4226280650 creator A5074205878 @default.
- W4226280650 creator A5082732322 @default.
- W4226280650 date "2021-12-01" @default.
- W4226280650 modified "2023-09-27" @default.
- W4226280650 title "Chukonu" @default.
- W4226280650 cites W1976821017 @default.
- W4226280650 cites W2038412523 @default.
- W4226280650 cites W2100830825 @default.
- W4226280650 cites W2106771621 @default.
- W4226280650 cites W2115934293 @default.
- W4226280650 cites W2160768644 @default.
- W4226280650 cites W2167889790 @default.
- W4226280650 cites W2173213060 @default.
- W4226280650 cites W2232745072 @default.
- W4226280650 cites W2260553848 @default.
- W4226280650 cites W2491983741 @default.
- W4226280650 cites W2508838500 @default.
- W4226280650 cites W2542459869 @default.
- W4226280650 cites W2613579336 @default.
- W4226280650 cites W2625392185 @default.
- W4226280650 cites W2757475250 @default.
- W4226280650 cites W2798434712 @default.
- W4226280650 cites W2945160848 @default.
- W4226280650 cites W2981617602 @default.
- W4226280650 cites W2981937105 @default.
- W4226280650 cites W3033308515 @default.
- W4226280650 doi "https://doi.org/10.14778/3503585.3503596" @default.
- W4226280650 hasPublicationYear "2021" @default.
- W4226280650 type Work @default.
- W4226280650 citedByCount "0" @default.
- W4226280650 crossrefType "journal-article" @default.
- W4226280650 hasAuthorship W4226280650A5002716694 @default.
- W4226280650 hasAuthorship W4226280650A5022309774 @default.
- W4226280650 hasAuthorship W4226280650A5025808877 @default.
- W4226280650 hasAuthorship W4226280650A5036015561 @default.
- W4226280650 hasAuthorship W4226280650A5039766485 @default.
- W4226280650 hasAuthorship W4226280650A5066504632 @default.
- W4226280650 hasAuthorship W4226280650A5069169048 @default.
- W4226280650 hasAuthorship W4226280650A5074205878 @default.
- W4226280650 hasAuthorship W4226280650A5082732322 @default.
- W4226280650 hasConcept C111919701 @default.
- W4226280650 hasConcept C149635348 @default.
- W4226280650 hasConcept C169590947 @default.
- W4226280650 hasConcept C173608175 @default.
- W4226280650 hasConcept C199360897 @default.
- W4226280650 hasConcept C2779960059 @default.
- W4226280650 hasConcept C2780513914 @default.
- W4226280650 hasConcept C2781215313 @default.
- W4226280650 hasConcept C41008148 @default.
- W4226280650 hasConcept C41681595 @default.
- W4226280650 hasConcept C68339613 @default.
- W4226280650 hasConcept C75684735 @default.
- W4226280650 hasConcept C77088390 @default.
- W4226280650 hasConceptScore W4226280650C111919701 @default.
- W4226280650 hasConceptScore W4226280650C149635348 @default.
- W4226280650 hasConceptScore W4226280650C169590947 @default.
- W4226280650 hasConceptScore W4226280650C173608175 @default.
- W4226280650 hasConceptScore W4226280650C199360897 @default.
- W4226280650 hasConceptScore W4226280650C2779960059 @default.
- W4226280650 hasConceptScore W4226280650C2780513914 @default.
- W4226280650 hasConceptScore W4226280650C2781215313 @default.
- W4226280650 hasConceptScore W4226280650C41008148 @default.
- W4226280650 hasConceptScore W4226280650C41681595 @default.
- W4226280650 hasConceptScore W4226280650C68339613 @default.
- W4226280650 hasConceptScore W4226280650C75684735 @default.
- W4226280650 hasConceptScore W4226280650C77088390 @default.
- W4226280650 hasIssue "4" @default.
- W4226280650 hasLocation W42262806501 @default.
- W4226280650 hasOpenAccess W4226280650 @default.
- W4226280650 hasPrimaryLocation W42262806501 @default.
- W4226280650 hasRelatedWork W1506438023 @default.
- W4226280650 hasRelatedWork W1547259518 @default.
- W4226280650 hasRelatedWork W1583465708 @default.
- W4226280650 hasRelatedWork W1784146144 @default.
- W4226280650 hasRelatedWork W2013156670 @default.
- W4226280650 hasRelatedWork W2053732522 @default.
- W4226280650 hasRelatedWork W2375927271 @default.
- W4226280650 hasRelatedWork W3100138449 @default.
- W4226280650 hasRelatedWork W4240445122 @default.
- W4226280650 hasRelatedWork W2479014312 @default.
- W4226280650 hasVolume "15" @default.
- W4226280650 isParatext "false" @default.
- W4226280650 isRetracted "false" @default.
- W4226280650 workType "article" @default.