Matches in SemOpenAlex for { <https://semopenalex.org/work/W4386005341> ?p ?o ?g. }
Showing items 1 to 68 of
68
with 100 items per page.
- W4386005341 endingPage "337" @default.
- W4386005341 startingPage "321" @default.
- W4386005341 abstract "The growth of computing power of large-scale HPC clusters has lead to the need for large high-bandwidth I/O systems. However, directly writing the large and bursty datasets to centralized parallel file systems can raise significant I/O contention issues on storage servers. To meet this requirement, high speed, local storage layers - Burst Buffers are being deployed in next-generation supercomputers. In this paper, we introduce the design of a burst buffer library integrated at the MPI layer - Hyper Burst Buffer (HBB) designed for aggregated write operations. HBB was implemented as a part of the Huawei Hyper-MPI (HMPI) framework, providing a storage framework that utilizes the efficient communication infrastructure of MPI, and the fast I/O capabilities of node-local NVMe storage devices. HBB seamlessly caches aggregation buffers to a local storage device and employs a lightweight background daemon that flushes burst buffer entries to a remote parallel file system, thereby achieving asynchronous I/O that is transparent to the application, as well as requiring a minimal memory overhead. The choice to integrate a burst buffer library at the MPI level encourages adoption by scientific community researchers due to the simple setup and usage. Our experiments on diverse scientific applications demonstrate that HBB is able to reduce the I/O overhead of application by an order of magnitude as well as decrease the total runtime of some I/O intensive cases by 50%." @default.
- W4386005341 created "2023-08-20" @default.
- W4386005341 creator A5049155562 @default.
- W4386005341 creator A5078531460 @default.
- W4386005341 date "2023-01-01" @default.
- W4386005341 modified "2023-10-12" @default.
- W4386005341 title "Hyper Burst Buffer: A Lightweight Burst Buffer I/O Library for High Performance Computing Applications" @default.
- W4386005341 cites W1893083538 @default.
- W4386005341 cites W2080628149 @default.
- W4386005341 cites W2083200599 @default.
- W4386005341 cites W2148897203 @default.
- W4386005341 cites W2156077349 @default.
- W4386005341 cites W2571435561 @default.
- W4386005341 cites W2583628881 @default.
- W4386005341 cites W2747566632 @default.
- W4386005341 cites W2768395119 @default.
- W4386005341 cites W2898657440 @default.
- W4386005341 cites W2913111236 @default.
- W4386005341 cites W2913959823 @default.
- W4386005341 cites W2987541847 @default.
- W4386005341 cites W2987917530 @default.
- W4386005341 cites W3046533131 @default.
- W4386005341 cites W4244254628 @default.
- W4386005341 doi "https://doi.org/10.1007/978-3-031-37963-5_23" @default.
- W4386005341 hasPublicationYear "2023" @default.
- W4386005341 type Work @default.
- W4386005341 citedByCount "0" @default.
- W4386005341 crossrefType "book-chapter" @default.
- W4386005341 hasAuthorship W4386005341A5049155562 @default.
- W4386005341 hasAuthorship W4386005341A5078531460 @default.
- W4386005341 hasConcept C111919701 @default.
- W4386005341 hasConcept C120314980 @default.
- W4386005341 hasConcept C145018004 @default.
- W4386005341 hasConcept C151319957 @default.
- W4386005341 hasConcept C2777253204 @default.
- W4386005341 hasConcept C2779960059 @default.
- W4386005341 hasConcept C31258907 @default.
- W4386005341 hasConcept C41008148 @default.
- W4386005341 hasConcept C76155785 @default.
- W4386005341 hasConcept C93996380 @default.
- W4386005341 hasConceptScore W4386005341C111919701 @default.
- W4386005341 hasConceptScore W4386005341C120314980 @default.
- W4386005341 hasConceptScore W4386005341C145018004 @default.
- W4386005341 hasConceptScore W4386005341C151319957 @default.
- W4386005341 hasConceptScore W4386005341C2777253204 @default.
- W4386005341 hasConceptScore W4386005341C2779960059 @default.
- W4386005341 hasConceptScore W4386005341C31258907 @default.
- W4386005341 hasConceptScore W4386005341C41008148 @default.
- W4386005341 hasConceptScore W4386005341C76155785 @default.
- W4386005341 hasConceptScore W4386005341C93996380 @default.
- W4386005341 hasLocation W43860053411 @default.
- W4386005341 hasOpenAccess W4386005341 @default.
- W4386005341 hasPrimaryLocation W43860053411 @default.
- W4386005341 hasRelatedWork W2043486348 @default.
- W4386005341 hasRelatedWork W2090419612 @default.
- W4386005341 hasRelatedWork W2178864020 @default.
- W4386005341 hasRelatedWork W2375183653 @default.
- W4386005341 hasRelatedWork W2771735890 @default.
- W4386005341 hasRelatedWork W2952967501 @default.
- W4386005341 hasRelatedWork W4254401644 @default.
- W4386005341 hasRelatedWork W4255410145 @default.
- W4386005341 hasRelatedWork W4298974246 @default.
- W4386005341 hasRelatedWork W2167636033 @default.
- W4386005341 isParatext "false" @default.
- W4386005341 isRetracted "false" @default.
- W4386005341 workType "book-chapter" @default.