Matches in SemOpenAlex for { <https://semopenalex.org/work/W4376163536> ?p ?o ?g. }
Showing items 1 to 59 of
59
with 100 items per page.
- W4376163536 abstract "External sorting is at the core of many operations in large-scale database systems, such as ordering and aggregation queries for large result sets, building indexes, sort-merge joins, duplicate removal, sharding, and record clustering. Unlike in-memory sorting, these algorithms need to work together with the OS and the filesystem to efficiently utilize system resources and minimize disk I/O. In this paper we describe ELSAR: a parallel external sorting algorithm that uses an innovative paradigm based on a learned data distribution model. The algorithm leverages the model to arrange the input records into mutually exclusive, monotonic, and equi-depth partitions that, once sorted, can simply be concatenated to form the output. This method completely eliminates the need for multi-way file merging, which is typically used in external sorting. We present thorough benchmarks for uniform and skewed datasets in various storage media, where we measure the sorting rates, size scalability, and energy efficiency of ELSAR and other sorting algorithms. We observed that ELSAR has up to 1.65x higher sorting rates than the next-best external sort (Nsort) on SSD drives and 5.31x higher than the GNU coreutils' sort utility on Intel Optane non-volatile memory. In addition, ELSAR supersedes the current winner of the SortBenchmark for the most energy-efficient external string sorting algorithm by an impressive margin of 41%. These results reinforce the premise that novel learning-enhanced algorithms can provide remarkable performance benefits over traditional ones." @default.
- W4376163536 created "2023-05-12" @default.
- W4376163536 creator A5007935841 @default.
- W4376163536 creator A5034086130 @default.
- W4376163536 date "2023-05-08" @default.
- W4376163536 modified "2023-10-01" @default.
- W4376163536 title "Parallel External Sorting of ASCII Records Using Learned Models" @default.
- W4376163536 doi "https://doi.org/10.48550/arxiv.2305.05671" @default.
- W4376163536 hasPublicationYear "2023" @default.
- W4376163536 type Work @default.
- W4376163536 citedByCount "0" @default.
- W4376163536 crossrefType "posted-content" @default.
- W4376163536 hasAuthorship W4376163536A5007935841 @default.
- W4376163536 hasAuthorship W4376163536A5034086130 @default.
- W4376163536 hasBestOaLocation W43761635361 @default.
- W4376163536 hasConcept C108094655 @default.
- W4376163536 hasConcept C111696304 @default.
- W4376163536 hasConcept C111919701 @default.
- W4376163536 hasConcept C11413529 @default.
- W4376163536 hasConcept C140086265 @default.
- W4376163536 hasConcept C173608175 @default.
- W4376163536 hasConcept C199360897 @default.
- W4376163536 hasConcept C2778692605 @default.
- W4376163536 hasConcept C41008148 @default.
- W4376163536 hasConcept C48044578 @default.
- W4376163536 hasConcept C77088390 @default.
- W4376163536 hasConcept C80444323 @default.
- W4376163536 hasConcept C82687282 @default.
- W4376163536 hasConcept C88548561 @default.
- W4376163536 hasConceptScore W4376163536C108094655 @default.
- W4376163536 hasConceptScore W4376163536C111696304 @default.
- W4376163536 hasConceptScore W4376163536C111919701 @default.
- W4376163536 hasConceptScore W4376163536C11413529 @default.
- W4376163536 hasConceptScore W4376163536C140086265 @default.
- W4376163536 hasConceptScore W4376163536C173608175 @default.
- W4376163536 hasConceptScore W4376163536C199360897 @default.
- W4376163536 hasConceptScore W4376163536C2778692605 @default.
- W4376163536 hasConceptScore W4376163536C41008148 @default.
- W4376163536 hasConceptScore W4376163536C48044578 @default.
- W4376163536 hasConceptScore W4376163536C77088390 @default.
- W4376163536 hasConceptScore W4376163536C80444323 @default.
- W4376163536 hasConceptScore W4376163536C82687282 @default.
- W4376163536 hasConceptScore W4376163536C88548561 @default.
- W4376163536 hasLocation W43761635361 @default.
- W4376163536 hasOpenAccess W4376163536 @default.
- W4376163536 hasPrimaryLocation W43761635361 @default.
- W4376163536 hasRelatedWork W2003515726 @default.
- W4376163536 hasRelatedWork W2011379812 @default.
- W4376163536 hasRelatedWork W2096192425 @default.
- W4376163536 hasRelatedWork W2096761913 @default.
- W4376163536 hasRelatedWork W2163742570 @default.
- W4376163536 hasRelatedWork W2548096898 @default.
- W4376163536 hasRelatedWork W2949157128 @default.
- W4376163536 hasRelatedWork W4297805531 @default.
- W4376163536 hasRelatedWork W4299489301 @default.
- W4376163536 hasRelatedWork W4306322080 @default.
- W4376163536 isParatext "false" @default.
- W4376163536 isRetracted "false" @default.
- W4376163536 workType "article" @default.