Matches in SemOpenAlex for { <https://semopenalex.org/work/W3085532996> ?p ?o ?g. }
Showing items 1 to 88 of
88
with 100 items per page.
- W3085532996 abstract "A scientific workflow is a set of interdependent compute tasks orchestrating large scale data analyses or in-silico experiments. Workflows often comprise thousands of tasks with heterogeneous resource requirements that need to be executed on distributed resources. Many workflow engines solve parallelization by submitting tasks to a batch scheduling system, which requires resource usage estimates that have to be provided by users. We investigate the possibility to improve upon inaccurate user estimates by incorporating an online feedback loop between workflow scheduling, resource usage prediction, and measurement.Our approach can learn resource usage of arbitrary type; in this paper, we demonstrate its effectiveness by predicting peak memory usage of tasks, as it is an especially sensitive resource type that leads to task termination if underestimated and leads to decreased throughput if overestimated.We compare online versions of standard machine learning models for peak memory usage prediction and analyze their interactions with different workflow scheduling strategies. By means of extensive simulation experiments, we found that the proposed feedback mechanism improves resource utilization and execution times compared to typical user estimates." @default.
- W3085532996 created "2020-09-21" @default.
- W3085532996 creator A5021780048 @default.
- W3085532996 creator A5055236937 @default.
- W3085532996 creator A5079718316 @default.
- W3085532996 date "2019-07-01" @default.
- W3085532996 modified "2023-09-27" @default.
- W3085532996 title "Feedback-Based Resource Allocation for Batch Scheduling of Scientific Workflows" @default.
- W3085532996 cites W2000899545 @default.
- W3085532996 cites W2028351695 @default.
- W3085532996 cites W2029282088 @default.
- W3085532996 cites W2034603054 @default.
- W3085532996 cites W2040466547 @default.
- W3085532996 cites W2045287414 @default.
- W3085532996 cites W2075068409 @default.
- W3085532996 cites W2078962046 @default.
- W3085532996 cites W2108905989 @default.
- W3085532996 cites W2112168774 @default.
- W3085532996 cites W2129542763 @default.
- W3085532996 cites W2139250332 @default.
- W3085532996 cites W2146438496 @default.
- W3085532996 cites W2149294210 @default.
- W3085532996 cites W2160121678 @default.
- W3085532996 cites W2202483651 @default.
- W3085532996 cites W2269030879 @default.
- W3085532996 cites W2425612555 @default.
- W3085532996 cites W2560127491 @default.
- W3085532996 cites W2561389184 @default.
- W3085532996 cites W2605897695 @default.
- W3085532996 cites W2763493608 @default.
- W3085532996 cites W2766666504 @default.
- W3085532996 cites W2766766128 @default.
- W3085532996 cites W2806583692 @default.
- W3085532996 doi "https://doi.org/10.1109/hpcs48598.2019.9188055" @default.
- W3085532996 hasPublicationYear "2019" @default.
- W3085532996 type Work @default.
- W3085532996 sameAs 3085532996 @default.
- W3085532996 citedByCount "6" @default.
- W3085532996 countsByYear W30855329962021 @default.
- W3085532996 countsByYear W30855329962022 @default.
- W3085532996 countsByYear W30855329962023 @default.
- W3085532996 crossrefType "proceedings-article" @default.
- W3085532996 hasAuthorship W3085532996A5021780048 @default.
- W3085532996 hasAuthorship W3085532996A5055236937 @default.
- W3085532996 hasAuthorship W3085532996A5079718316 @default.
- W3085532996 hasConcept C120314980 @default.
- W3085532996 hasConcept C162324750 @default.
- W3085532996 hasConcept C177212765 @default.
- W3085532996 hasConcept C17744445 @default.
- W3085532996 hasConcept C185874996 @default.
- W3085532996 hasConcept C19612761 @default.
- W3085532996 hasConcept C199539241 @default.
- W3085532996 hasConcept C206345919 @default.
- W3085532996 hasConcept C206729178 @default.
- W3085532996 hasConcept C21547014 @default.
- W3085532996 hasConcept C31258907 @default.
- W3085532996 hasConcept C41008148 @default.
- W3085532996 hasConcept C77088390 @default.
- W3085532996 hasConceptScore W3085532996C120314980 @default.
- W3085532996 hasConceptScore W3085532996C162324750 @default.
- W3085532996 hasConceptScore W3085532996C177212765 @default.
- W3085532996 hasConceptScore W3085532996C17744445 @default.
- W3085532996 hasConceptScore W3085532996C185874996 @default.
- W3085532996 hasConceptScore W3085532996C19612761 @default.
- W3085532996 hasConceptScore W3085532996C199539241 @default.
- W3085532996 hasConceptScore W3085532996C206345919 @default.
- W3085532996 hasConceptScore W3085532996C206729178 @default.
- W3085532996 hasConceptScore W3085532996C21547014 @default.
- W3085532996 hasConceptScore W3085532996C31258907 @default.
- W3085532996 hasConceptScore W3085532996C41008148 @default.
- W3085532996 hasConceptScore W3085532996C77088390 @default.
- W3085532996 hasLocation W30855329961 @default.
- W3085532996 hasOpenAccess W3085532996 @default.
- W3085532996 hasPrimaryLocation W30855329961 @default.
- W3085532996 hasRelatedWork W117162150 @default.
- W3085532996 hasRelatedWork W1271724408 @default.
- W3085532996 hasRelatedWork W1988746895 @default.
- W3085532996 hasRelatedWork W2010961992 @default.
- W3085532996 hasRelatedWork W2126020875 @default.
- W3085532996 hasRelatedWork W2356938388 @default.
- W3085532996 hasRelatedWork W2377329191 @default.
- W3085532996 hasRelatedWork W2964552794 @default.
- W3085532996 hasRelatedWork W3131615421 @default.
- W3085532996 hasRelatedWork W3133769988 @default.
- W3085532996 isParatext "false" @default.
- W3085532996 isRetracted "false" @default.
- W3085532996 magId "3085532996" @default.
- W3085532996 workType "article" @default.