Matches in SemOpenAlex for { <https://semopenalex.org/work/W3204666133> ?p ?o ?g. }
- W3204666133 abstract "MapReduce-based SQL processing frameworks, such as Hive and Spark SQL, are widely used to support big data analytics. Currently these systems mainly adopt the record-at-a-time execution model, which is less efficient in terms of CPU utilization. In contrast, vectorized execution is able to make better use of CPU cache by bulk processing a record batch at a time. However, simply applying vectorized execution to MapReduce-based frameworks results in low efficient vectorized shuffle. Moreover, existing vectorized execution donot make full use of CPU cache for complex operators (e.g. Sort and Aggregation). In this paper, we present VEE, a thorough vectorized execution engine designed for SQL query processing on Spark. First, VEE designs compact in-memory data layout and serialization-aware assembling for vectorized shuffle to expedites shuffle execution, since they reduce shuffle data footprint and related computations. Secondly, VEE applies in-memory record batch rearrangement for Sort and Aggregation to greatly reduce random memory access and increase query performance. Thirdly, VEE carefully designs operator-aware batch length when handling different operators, which makes better utilization of CPU cache and increases query performance. We conduct extensive performance evaluations. The experiment results show that the performance speedup of VEE against Spark is up to 72.7% and 25.0% on average for OLAP workloads (TPC-H). The vectorized execution technologies in VEE are also applicable to other MapReduce-based data analytic frameworks to improve their query performance." @default.
- W3204666133 created "2021-10-11" @default.
- W3204666133 creator A5017014737 @default.
- W3204666133 creator A5023744370 @default.
- W3204666133 creator A5082173488 @default.
- W3204666133 date "2021-08-09" @default.
- W3204666133 modified "2023-10-16" @default.
- W3204666133 title "Using Vectorized Execution to Improve SQL Query Performance on Spark" @default.
- W3204666133 cites W1605782097 @default.
- W3204666133 cites W1902965424 @default.
- W3204666133 cites W1998271633 @default.
- W3204666133 cites W2003515726 @default.
- W3204666133 cites W2006552857 @default.
- W3204666133 cites W2021932022 @default.
- W3204666133 cites W2029866183 @default.
- W3204666133 cites W2038412523 @default.
- W3204666133 cites W2056014488 @default.
- W3204666133 cites W2067051372 @default.
- W3204666133 cites W2067089961 @default.
- W3204666133 cites W2076164405 @default.
- W3204666133 cites W2080092502 @default.
- W3204666133 cites W2081804145 @default.
- W3204666133 cites W2082695854 @default.
- W3204666133 cites W2086977914 @default.
- W3204666133 cites W2102729946 @default.
- W3204666133 cites W2106771621 @default.
- W3204666133 cites W2106911865 @default.
- W3204666133 cites W2110160586 @default.
- W3204666133 cites W2114854276 @default.
- W3204666133 cites W2125529470 @default.
- W3204666133 cites W2127766448 @default.
- W3204666133 cites W2135003477 @default.
- W3204666133 cites W2158913762 @default.
- W3204666133 cites W2166955231 @default.
- W3204666133 cites W2278783412 @default.
- W3204666133 cites W2296349066 @default.
- W3204666133 cites W2406955896 @default.
- W3204666133 cites W2433128352 @default.
- W3204666133 cites W2618868084 @default.
- W3204666133 cites W2765206444 @default.
- W3204666133 cites W2798457757 @default.
- W3204666133 cites W3010415500 @default.
- W3204666133 cites W3136655632 @default.
- W3204666133 doi "https://doi.org/10.1145/3472456.3472495" @default.
- W3204666133 hasPublicationYear "2021" @default.
- W3204666133 type Work @default.
- W3204666133 sameAs 3204666133 @default.
- W3204666133 citedByCount "2" @default.
- W3204666133 countsByYear W32046661332022 @default.
- W3204666133 crossrefType "proceedings-article" @default.
- W3204666133 hasAuthorship W3204666133A5017014737 @default.
- W3204666133 hasAuthorship W3204666133A5023744370 @default.
- W3204666133 hasAuthorship W3204666133A5082173488 @default.
- W3204666133 hasConcept C111919701 @default.
- W3204666133 hasConcept C115537543 @default.
- W3204666133 hasConcept C123593499 @default.
- W3204666133 hasConcept C135572916 @default.
- W3204666133 hasConcept C164120249 @default.
- W3204666133 hasConcept C173608175 @default.
- W3204666133 hasConcept C194222762 @default.
- W3204666133 hasConcept C199360897 @default.
- W3204666133 hasConcept C201932085 @default.
- W3204666133 hasConcept C23123220 @default.
- W3204666133 hasConcept C2781215313 @default.
- W3204666133 hasConcept C2989134064 @default.
- W3204666133 hasConcept C41008148 @default.
- W3204666133 hasConcept C49154492 @default.
- W3204666133 hasConcept C510870499 @default.
- W3204666133 hasConcept C68339613 @default.
- W3204666133 hasConcept C77088390 @default.
- W3204666133 hasConcept C79158427 @default.
- W3204666133 hasConcept C88548561 @default.
- W3204666133 hasConcept C97854310 @default.
- W3204666133 hasConceptScore W3204666133C111919701 @default.
- W3204666133 hasConceptScore W3204666133C115537543 @default.
- W3204666133 hasConceptScore W3204666133C123593499 @default.
- W3204666133 hasConceptScore W3204666133C135572916 @default.
- W3204666133 hasConceptScore W3204666133C164120249 @default.
- W3204666133 hasConceptScore W3204666133C173608175 @default.
- W3204666133 hasConceptScore W3204666133C194222762 @default.
- W3204666133 hasConceptScore W3204666133C199360897 @default.
- W3204666133 hasConceptScore W3204666133C201932085 @default.
- W3204666133 hasConceptScore W3204666133C23123220 @default.
- W3204666133 hasConceptScore W3204666133C2781215313 @default.
- W3204666133 hasConceptScore W3204666133C2989134064 @default.
- W3204666133 hasConceptScore W3204666133C41008148 @default.
- W3204666133 hasConceptScore W3204666133C49154492 @default.
- W3204666133 hasConceptScore W3204666133C510870499 @default.
- W3204666133 hasConceptScore W3204666133C68339613 @default.
- W3204666133 hasConceptScore W3204666133C77088390 @default.
- W3204666133 hasConceptScore W3204666133C79158427 @default.
- W3204666133 hasConceptScore W3204666133C88548561 @default.
- W3204666133 hasConceptScore W3204666133C97854310 @default.
- W3204666133 hasLocation W32046661331 @default.
- W3204666133 hasOpenAccess W3204666133 @default.
- W3204666133 hasPrimaryLocation W32046661331 @default.
- W3204666133 hasRelatedWork W1509211761 @default.
- W3204666133 hasRelatedWork W1531488649 @default.
- W3204666133 hasRelatedWork W20993042 @default.
- W3204666133 hasRelatedWork W2121387334 @default.