Matches in SemOpenAlex for { <https://semopenalex.org/work/W2904346168> ?p ?o ?g. }
Showing items 1 to 90 of
90
with 100 items per page.
- W2904346168 endingPage "74" @default.
- W2904346168 startingPage "74" @default.
- W2904346168 abstract "Seismic data-sets are extremely large and are broken into data files, ranging in size from 100s of GiBs to 10s of TiBs and larger. The parallel I/O for these files is complex due to the amount of data along with varied and multiple access patterns within individual files. Properties of legacy file formats, such as the de-facto standard SEG-Y, also contribute to the decrease in developer productivity while working with these files. SEG-Y files embed their own internal layout which could lead to conflict with traditional, file-system-level layout optimization schemes. Additionally, as seismic files continue to increase in size, memory bottlenecks will be exacerbated, resulting in the need for smart I/O optimization not only to increase the efficiency of read/writes, but to manage memory usage as well. The ExSeisDat (Extreme-Scale Seismic Data) set of libraries addresses these problems through the development and implementation of easy to use, object oriented libraries that are portable and open source with bindings available in multiple languages. The lower level parallel I/O library, ExSeisPIOL (Extreme-Scale Seismic Parallel I/O Library), targets SEG-Y and other proprietary formats, simplifying I/O by internally interfacing MPI-I/O and other I/O interfaces. The I/O is explicitly handled; end users only need to define the memory limits, decomposition of I/O across processes, and data access patterns when reading and writing data. ExSeisPIOL bridges the layout gap between the SEG-Y file structure and file system organization. The higher level parallel seismic workflow library, ExSeisFlow (Extreme-Scale Seismic workFlow), leverages ExSeisPIOL, further simplifying I/O by implicitly handling all I/O parameters, thus allowing geophysicists to focus on domain-specific development. Operations in ExSeisFlow focus on prestack processing and can be performed on single traces, individual gathers, and across entire surveys, including out of core sorting, binning, filtering, and transforming. To optimize memory management, the workflow only reads in data pertinent to the operations being performed instead of an entire file. A smart caching system manages the read data, discarding it when no longer needed in the workflow. As the libraries are optimized to handle spatial and temporal locality, they are a natural fit to burst buffer technologies, particularly DDN’s Infinite Memory Engine (IME) system. With appropriate access semantics or through the direct exploitation of the low-level interfaces, the ExSeisDat stack on IME delivers a significant improvement to I/O performance over standalone parallel file systems like Lustre." @default.
- W2904346168 created "2018-12-22" @default.
- W2904346168 creator A5003468283 @default.
- W2904346168 creator A5007234078 @default.
- W2904346168 creator A5007658945 @default.
- W2904346168 creator A5027217292 @default.
- W2904346168 creator A5028855848 @default.
- W2904346168 creator A5030285280 @default.
- W2904346168 creator A5034844793 @default.
- W2904346168 creator A5053712339 @default.
- W2904346168 creator A5080111528 @default.
- W2904346168 date "2018-01-01" @default.
- W2904346168 modified "2023-10-18" @default.
- W2904346168 title "ExSeisDat: A set of parallel I/O and workflow libraries for petroleum seismology" @default.
- W2904346168 cites W1969065421 @default.
- W2904346168 cites W1974534679 @default.
- W2904346168 cites W1981432246 @default.
- W2904346168 cites W2028705462 @default.
- W2904346168 cites W2122654826 @default.
- W2904346168 cites W2127995641 @default.
- W2904346168 cites W2155521027 @default.
- W2904346168 cites W2573772098 @default.
- W2904346168 cites W2749188226 @default.
- W2904346168 cites W4213164595 @default.
- W2904346168 doi "https://doi.org/10.2516/ogst/2018048" @default.
- W2904346168 hasPublicationYear "2018" @default.
- W2904346168 type Work @default.
- W2904346168 sameAs 2904346168 @default.
- W2904346168 citedByCount "3" @default.
- W2904346168 countsByYear W29043461682019 @default.
- W2904346168 countsByYear W29043461682021 @default.
- W2904346168 countsByYear W29043461682022 @default.
- W2904346168 crossrefType "journal-article" @default.
- W2904346168 hasAuthorship W2904346168A5003468283 @default.
- W2904346168 hasAuthorship W2904346168A5007234078 @default.
- W2904346168 hasAuthorship W2904346168A5007658945 @default.
- W2904346168 hasAuthorship W2904346168A5027217292 @default.
- W2904346168 hasAuthorship W2904346168A5028855848 @default.
- W2904346168 hasAuthorship W2904346168A5030285280 @default.
- W2904346168 hasAuthorship W2904346168A5034844793 @default.
- W2904346168 hasAuthorship W2904346168A5053712339 @default.
- W2904346168 hasAuthorship W2904346168A5080111528 @default.
- W2904346168 hasBestOaLocation W29043461681 @default.
- W2904346168 hasConcept C111919701 @default.
- W2904346168 hasConcept C177212765 @default.
- W2904346168 hasConcept C177264268 @default.
- W2904346168 hasConcept C199360897 @default.
- W2904346168 hasConcept C2776303644 @default.
- W2904346168 hasConcept C2780940931 @default.
- W2904346168 hasConcept C2781057727 @default.
- W2904346168 hasConcept C41008148 @default.
- W2904346168 hasConcept C77088390 @default.
- W2904346168 hasConcept C9390403 @default.
- W2904346168 hasConcept C95637964 @default.
- W2904346168 hasConceptScore W2904346168C111919701 @default.
- W2904346168 hasConceptScore W2904346168C177212765 @default.
- W2904346168 hasConceptScore W2904346168C177264268 @default.
- W2904346168 hasConceptScore W2904346168C199360897 @default.
- W2904346168 hasConceptScore W2904346168C2776303644 @default.
- W2904346168 hasConceptScore W2904346168C2780940931 @default.
- W2904346168 hasConceptScore W2904346168C2781057727 @default.
- W2904346168 hasConceptScore W2904346168C41008148 @default.
- W2904346168 hasConceptScore W2904346168C77088390 @default.
- W2904346168 hasConceptScore W2904346168C9390403 @default.
- W2904346168 hasConceptScore W2904346168C95637964 @default.
- W2904346168 hasLocation W29043461681 @default.
- W2904346168 hasLocation W29043461682 @default.
- W2904346168 hasLocation W29043461683 @default.
- W2904346168 hasLocation W29043461684 @default.
- W2904346168 hasLocation W29043461685 @default.
- W2904346168 hasLocation W29043461686 @default.
- W2904346168 hasOpenAccess W2904346168 @default.
- W2904346168 hasPrimaryLocation W29043461681 @default.
- W2904346168 hasRelatedWork W2097829252 @default.
- W2904346168 hasRelatedWork W2163923355 @default.
- W2904346168 hasRelatedWork W2361508424 @default.
- W2904346168 hasRelatedWork W2371176883 @default.
- W2904346168 hasRelatedWork W2888789739 @default.
- W2904346168 hasRelatedWork W2898657440 @default.
- W2904346168 hasRelatedWork W4247882433 @default.
- W2904346168 hasRelatedWork W4313226861 @default.
- W2904346168 hasRelatedWork W938319407 @default.
- W2904346168 hasRelatedWork W1550839482 @default.
- W2904346168 hasVolume "73" @default.
- W2904346168 isParatext "false" @default.
- W2904346168 isRetracted "false" @default.
- W2904346168 magId "2904346168" @default.
- W2904346168 workType "article" @default.