Matches in SemOpenAlex for { <https://semopenalex.org/work/W3157788139> ?p ?o ?g. }
Showing items 1 to 96 of
96
with 100 items per page.
- W3157788139 endingPage "e527" @default.
- W3157788139 startingPage "e527" @default.
- W3157788139 abstract "Complex scientific experiments from various domains are typically modeled as workflows and executed on large-scale machines using a Parallel Workflow Management System (WMS). Since such executions usually last for hours or days, some WMSs provide user steering support, i.e., they allow users to run data analyses and, depending on the results, adapt the workflows at runtime. A challenge in the parallel execution control design is to manage workflow data for efficient executions while enabling user steering support. Data access for high scalability is typically transaction-oriented, while for data analysis, it is online analytical-oriented so that managing such hybrid workloads makes the challenge even harder. In this work, we present SchalaDB, an architecture with a set of design principles and techniques based on distributed in-memory data management for efficient workflow execution control and user steering. We propose a distributed data design for scalable workflow task scheduling and high availability driven by a parallel and distributed in-memory DBMS. To evaluate our proposal, we develop d-Chiron, a WMS designed according to SchalaDB's principles. We carry out an extensive experimental evaluation on an HPC cluster with up to 960 computing cores. Among other analyses, we show that even when running data analyses for user steering, SchalaDB's overhead is negligible for workloads composed of hundreds of concurrent tasks on shared data. Our results encourage workflow engine developers to follow a parallel and distributed data-oriented approach not only for scheduling and monitoring but also for user steering." @default.
- W3157788139 created "2021-05-10" @default.
- W3157788139 creator A5039896734 @default.
- W3157788139 creator A5041964026 @default.
- W3157788139 creator A5047525268 @default.
- W3157788139 creator A5050455034 @default.
- W3157788139 creator A5053215914 @default.
- W3157788139 creator A5078974702 @default.
- W3157788139 date "2021-05-07" @default.
- W3157788139 modified "2023-09-25" @default.
- W3157788139 title "Distributed in-memory data management for workflow executions" @default.
- W3157788139 cites W1502629466 @default.
- W3157788139 cites W1532114435 @default.
- W3157788139 cites W1798528872 @default.
- W3157788139 cites W1974752004 @default.
- W3157788139 cites W1983704199 @default.
- W3157788139 cites W2008285031 @default.
- W3157788139 cites W2078962046 @default.
- W3157788139 cites W2169867310 @default.
- W3157788139 cites W2266789289 @default.
- W3157788139 cites W2576436989 @default.
- W3157788139 cites W2587995914 @default.
- W3157788139 cites W2618602062 @default.
- W3157788139 cites W2760122776 @default.
- W3157788139 cites W2771577361 @default.
- W3157788139 cites W2808063726 @default.
- W3157788139 cites W2889551824 @default.
- W3157788139 cites W2946003964 @default.
- W3157788139 cites W3088331312 @default.
- W3157788139 cites W4230811558 @default.
- W3157788139 cites W4238431759 @default.
- W3157788139 doi "https://doi.org/10.7717/peerj-cs.527" @default.
- W3157788139 hasPubMedCentralId "https://www.ncbi.nlm.nih.gov/pmc/articles/8114816" @default.
- W3157788139 hasPubMedId "https://pubmed.ncbi.nlm.nih.gov/34013039" @default.
- W3157788139 hasPublicationYear "2021" @default.
- W3157788139 type Work @default.
- W3157788139 sameAs 3157788139 @default.
- W3157788139 citedByCount "2" @default.
- W3157788139 countsByYear W31577881392021 @default.
- W3157788139 countsByYear W31577881392023 @default.
- W3157788139 crossrefType "journal-article" @default.
- W3157788139 hasAuthorship W3157788139A5039896734 @default.
- W3157788139 hasAuthorship W3157788139A5041964026 @default.
- W3157788139 hasAuthorship W3157788139A5047525268 @default.
- W3157788139 hasAuthorship W3157788139A5050455034 @default.
- W3157788139 hasAuthorship W3157788139A5053215914 @default.
- W3157788139 hasAuthorship W3157788139A5078974702 @default.
- W3157788139 hasBestOaLocation W31577881391 @default.
- W3157788139 hasConcept C120314980 @default.
- W3157788139 hasConcept C140824633 @default.
- W3157788139 hasConcept C162324750 @default.
- W3157788139 hasConcept C177212765 @default.
- W3157788139 hasConcept C188220564 @default.
- W3157788139 hasConcept C19612761 @default.
- W3157788139 hasConcept C206729178 @default.
- W3157788139 hasConcept C21547014 @default.
- W3157788139 hasConcept C41008148 @default.
- W3157788139 hasConcept C48044578 @default.
- W3157788139 hasConcept C77088390 @default.
- W3157788139 hasConceptScore W3157788139C120314980 @default.
- W3157788139 hasConceptScore W3157788139C140824633 @default.
- W3157788139 hasConceptScore W3157788139C162324750 @default.
- W3157788139 hasConceptScore W3157788139C177212765 @default.
- W3157788139 hasConceptScore W3157788139C188220564 @default.
- W3157788139 hasConceptScore W3157788139C19612761 @default.
- W3157788139 hasConceptScore W3157788139C206729178 @default.
- W3157788139 hasConceptScore W3157788139C21547014 @default.
- W3157788139 hasConceptScore W3157788139C41008148 @default.
- W3157788139 hasConceptScore W3157788139C48044578 @default.
- W3157788139 hasConceptScore W3157788139C77088390 @default.
- W3157788139 hasLocation W31577881391 @default.
- W3157788139 hasLocation W31577881392 @default.
- W3157788139 hasLocation W31577881393 @default.
- W3157788139 hasLocation W31577881394 @default.
- W3157788139 hasLocation W31577881395 @default.
- W3157788139 hasLocation W31577881396 @default.
- W3157788139 hasLocation W31577881397 @default.
- W3157788139 hasOpenAccess W3157788139 @default.
- W3157788139 hasPrimaryLocation W31577881391 @default.
- W3157788139 hasRelatedWork W1533256563 @default.
- W3157788139 hasRelatedWork W1887920917 @default.
- W3157788139 hasRelatedWork W2127060079 @default.
- W3157788139 hasRelatedWork W2148259456 @default.
- W3157788139 hasRelatedWork W2166433032 @default.
- W3157788139 hasRelatedWork W2349553854 @default.
- W3157788139 hasRelatedWork W2356938388 @default.
- W3157788139 hasRelatedWork W2372773112 @default.
- W3157788139 hasRelatedWork W2377329191 @default.
- W3157788139 hasRelatedWork W1969197689 @default.
- W3157788139 hasVolume "7" @default.
- W3157788139 isParatext "false" @default.
- W3157788139 isRetracted "false" @default.
- W3157788139 magId "3157788139" @default.
- W3157788139 workType "article" @default.