Matches in SemOpenAlex for { <https://semopenalex.org/work/W3043075661> ?p ?o ?g. }
Showing items 1 to 86 of
86
with 100 items per page.
- W3043075661 abstract "Many scientific applications operate on data sets that span hundreds of Gigabytes or even Terabytes in size. Large data sets often use compression to reduce the size of the files. Yet as of today, parallel I/O libraries do not support reading and writing compressed files, necessitating either expensive sequential compression/decompression operations before/after the simulation, or omitting advanced features of parallel I/O libraries, such as collective I/O operations. This paper introduces parallel I/O on compressed data files, discusses the key challenges, requirements, and solutions for supporting compressed data files in MPI I/O, as well as limitations on some MPI I/O operations when using compressed data files. The paper details handling of individual read and write operations of compressed data files, and presents an extension to the two-phase collective I/O algorithm to support data compression. The paper further presents and evaluates an implementation based on the Snappy compression library and the OMPIO parallel I/O framework. The performance evaluation using multiple data sets demonstrate significant performance benefits when using data compression on a parallel BeeGFS file system." @default.
- W3043075661 created "2020-07-23" @default.
- W3043075661 creator A5037696732 @default.
- W3043075661 creator A5064445792 @default.
- W3043075661 date "2020-05-01" @default.
- W3043075661 modified "2023-09-26" @default.
- W3043075661 title "Parallel I/O on Compressed Data Files: Semantics, Algorithms, and Performance Evaluation" @default.
- W3043075661 cites W109129346 @default.
- W3043075661 cites W1499782454 @default.
- W3043075661 cites W1983041039 @default.
- W3043075661 cites W1994415548 @default.
- W3043075661 cites W2066818624 @default.
- W3043075661 cites W2076315871 @default.
- W3043075661 cites W2080628149 @default.
- W3043075661 cites W2083200599 @default.
- W3043075661 cites W2097590615 @default.
- W3043075661 cites W2111022129 @default.
- W3043075661 cites W2127883272 @default.
- W3043075661 cites W2129512728 @default.
- W3043075661 cites W2130836080 @default.
- W3043075661 cites W2154014653 @default.
- W3043075661 cites W2164566630 @default.
- W3043075661 cites W2167870856 @default.
- W3043075661 cites W2724704678 @default.
- W3043075661 doi "https://doi.org/10.1109/ccgrid49817.2020.00-74" @default.
- W3043075661 hasPublicationYear "2020" @default.
- W3043075661 type Work @default.
- W3043075661 sameAs 3043075661 @default.
- W3043075661 citedByCount "1" @default.
- W3043075661 countsByYear W30430756612023 @default.
- W3043075661 crossrefType "proceedings-article" @default.
- W3043075661 hasAuthorship W3043075661A5037696732 @default.
- W3043075661 hasAuthorship W3043075661A5064445792 @default.
- W3043075661 hasConcept C111919701 @default.
- W3043075661 hasConcept C11413529 @default.
- W3043075661 hasConcept C127413603 @default.
- W3043075661 hasConcept C159985019 @default.
- W3043075661 hasConcept C171146098 @default.
- W3043075661 hasConcept C171730128 @default.
- W3043075661 hasConcept C173608175 @default.
- W3043075661 hasConcept C180016635 @default.
- W3043075661 hasConcept C192562407 @default.
- W3043075661 hasConcept C199683683 @default.
- W3043075661 hasConcept C25797200 @default.
- W3043075661 hasConcept C26517878 @default.
- W3043075661 hasConcept C2776029614 @default.
- W3043075661 hasConcept C2781057727 @default.
- W3043075661 hasConcept C41008148 @default.
- W3043075661 hasConcept C511840579 @default.
- W3043075661 hasConcept C77088390 @default.
- W3043075661 hasConcept C78548338 @default.
- W3043075661 hasConceptScore W3043075661C111919701 @default.
- W3043075661 hasConceptScore W3043075661C11413529 @default.
- W3043075661 hasConceptScore W3043075661C127413603 @default.
- W3043075661 hasConceptScore W3043075661C159985019 @default.
- W3043075661 hasConceptScore W3043075661C171146098 @default.
- W3043075661 hasConceptScore W3043075661C171730128 @default.
- W3043075661 hasConceptScore W3043075661C173608175 @default.
- W3043075661 hasConceptScore W3043075661C180016635 @default.
- W3043075661 hasConceptScore W3043075661C192562407 @default.
- W3043075661 hasConceptScore W3043075661C199683683 @default.
- W3043075661 hasConceptScore W3043075661C25797200 @default.
- W3043075661 hasConceptScore W3043075661C26517878 @default.
- W3043075661 hasConceptScore W3043075661C2776029614 @default.
- W3043075661 hasConceptScore W3043075661C2781057727 @default.
- W3043075661 hasConceptScore W3043075661C41008148 @default.
- W3043075661 hasConceptScore W3043075661C511840579 @default.
- W3043075661 hasConceptScore W3043075661C77088390 @default.
- W3043075661 hasConceptScore W3043075661C78548338 @default.
- W3043075661 hasLocation W30430756611 @default.
- W3043075661 hasOpenAccess W3043075661 @default.
- W3043075661 hasPrimaryLocation W30430756611 @default.
- W3043075661 hasRelatedWork W2137954033 @default.
- W3043075661 hasRelatedWork W2559335251 @default.
- W3043075661 hasRelatedWork W2574096291 @default.
- W3043075661 hasRelatedWork W3013047064 @default.
- W3043075661 hasRelatedWork W3029188025 @default.
- W3043075661 hasRelatedWork W3043075661 @default.
- W3043075661 hasRelatedWork W4200516394 @default.
- W3043075661 hasRelatedWork W4313393809 @default.
- W3043075661 hasRelatedWork W4313450465 @default.
- W3043075661 hasRelatedWork W4379740563 @default.
- W3043075661 isParatext "false" @default.
- W3043075661 isRetracted "false" @default.
- W3043075661 magId "3043075661" @default.
- W3043075661 workType "article" @default.