Matches in SemOpenAlex for { <https://semopenalex.org/work/W4387449654> ?p ?o ?g. }
Showing items 1 to 68 of
68
with 100 items per page.
- W4387449654 abstract "We observe the emergence of a new generation of scientific workflows that process data produced at a sustained rate by scientific instruments and large scale numerical simulations. This data is consumed by multiple analysis, visualization, or Machine Learning components not only to enable inference and justify the scientific program, but also to monitor and steer the evolution of these experiments. In such workflows, moving intermediate data efficiently is key to performance, more than efficiently scheduling computational tasks. However, most traditional workflow management systems focus on optimizing task scheduling and then deal with data management, assuming a “move little, compute for long” model, which makes them unfit to the efficient management of this new generation of workflows. Therefore, we advocate for a new way to manage scientific workflows. We propose to consider an efficiently and independently managed data plane that can store and stream data. Workflows compute components, in the application plane can then interact with the data plane, abstracted from complexities of data management. Then, the role of a workflow management system would become that of a control plane that allows users to connect services together to execute the workflow and manages connections between the application and data planes. In this position paper, we characterize several next-generation workflow motifs and describe how their interaction with the data plane is a challenge to traditional workflow management systems. Then, we express a set of requirements that a workflow management system should meet to efficiently manage next-generation workflows at different scales. Based on these requirements, we expose our vision of driving next-generation workflows from the data plane and list remaining open challenges." @default.
- W4387449654 created "2023-10-10" @default.
- W4387449654 creator A5021627261 @default.
- W4387449654 creator A5030373337 @default.
- W4387449654 creator A5072339196 @default.
- W4387449654 creator A5079113863 @default.
- W4387449654 date "2023-10-09" @default.
- W4387449654 modified "2023-10-11" @default.
- W4387449654 title "Driving Next-Generation Workflows from the Data Plane" @default.
- W4387449654 doi "https://doi.org/10.1109/e-science58273.2023.10254849" @default.
- W4387449654 hasPublicationYear "2023" @default.
- W4387449654 type Work @default.
- W4387449654 citedByCount "0" @default.
- W4387449654 crossrefType "proceedings-article" @default.
- W4387449654 hasAuthorship W4387449654A5021627261 @default.
- W4387449654 hasAuthorship W4387449654A5030373337 @default.
- W4387449654 hasAuthorship W4387449654A5072339196 @default.
- W4387449654 hasAuthorship W4387449654A5079113863 @default.
- W4387449654 hasConcept C115903868 @default.
- W4387449654 hasConcept C120314980 @default.
- W4387449654 hasConcept C140824633 @default.
- W4387449654 hasConcept C154945302 @default.
- W4387449654 hasConcept C162324750 @default.
- W4387449654 hasConcept C1668388 @default.
- W4387449654 hasConcept C177212765 @default.
- W4387449654 hasConcept C188220564 @default.
- W4387449654 hasConcept C19612761 @default.
- W4387449654 hasConcept C206729178 @default.
- W4387449654 hasConcept C21547014 @default.
- W4387449654 hasConcept C2522767166 @default.
- W4387449654 hasConcept C2776214188 @default.
- W4387449654 hasConcept C41008148 @default.
- W4387449654 hasConcept C67186912 @default.
- W4387449654 hasConcept C77088390 @default.
- W4387449654 hasConceptScore W4387449654C115903868 @default.
- W4387449654 hasConceptScore W4387449654C120314980 @default.
- W4387449654 hasConceptScore W4387449654C140824633 @default.
- W4387449654 hasConceptScore W4387449654C154945302 @default.
- W4387449654 hasConceptScore W4387449654C162324750 @default.
- W4387449654 hasConceptScore W4387449654C1668388 @default.
- W4387449654 hasConceptScore W4387449654C177212765 @default.
- W4387449654 hasConceptScore W4387449654C188220564 @default.
- W4387449654 hasConceptScore W4387449654C19612761 @default.
- W4387449654 hasConceptScore W4387449654C206729178 @default.
- W4387449654 hasConceptScore W4387449654C21547014 @default.
- W4387449654 hasConceptScore W4387449654C2522767166 @default.
- W4387449654 hasConceptScore W4387449654C2776214188 @default.
- W4387449654 hasConceptScore W4387449654C41008148 @default.
- W4387449654 hasConceptScore W4387449654C67186912 @default.
- W4387449654 hasConceptScore W4387449654C77088390 @default.
- W4387449654 hasFunder F4320306084 @default.
- W4387449654 hasFunder F4320338287 @default.
- W4387449654 hasLocation W43874496541 @default.
- W4387449654 hasOpenAccess W4387449654 @default.
- W4387449654 hasPrimaryLocation W43874496541 @default.
- W4387449654 hasRelatedWork W2091596831 @default.
- W4387449654 hasRelatedWork W2352344200 @default.
- W4387449654 hasRelatedWork W2365658322 @default.
- W4387449654 hasRelatedWork W2367975678 @default.
- W4387449654 hasRelatedWork W2373541195 @default.
- W4387449654 hasRelatedWork W2375552622 @default.
- W4387449654 hasRelatedWork W2376410910 @default.
- W4387449654 hasRelatedWork W2379425324 @default.
- W4387449654 hasRelatedWork W2906819665 @default.
- W4387449654 hasRelatedWork W329008868 @default.
- W4387449654 isParatext "false" @default.
- W4387449654 isRetracted "false" @default.
- W4387449654 workType "article" @default.