Matches in SemOpenAlex for { <https://semopenalex.org/work/W2296687957> ?p ?o ?g. }
Showing items 1 to 71 of
71
with 100 items per page.
- W2296687957 abstract "Scientists in different fields, such as high energy physics, earth science, and astronomy are developing large-scale workflow applications. In many use cases, scientists need to run a set of interrelated but independent workflows (i.e., Workflow ensembles) for the entire scientific analysis. As a workflow ensemble usually contains many sub-workflows in each of which hundreds or thousands of jobs exist with precedence constraints, the execution of such a workflow ensemble makes a great concern with cost even using elastic and pay-as-you-go cloud resources. In this paper, we address two main challenges in executing large-scale workflow ensembles in public clouds with both cost and deadline constraints: (1) execution coordination, and (2) resource provisioning. To this end, we develop a new pulling based workflow execution system with a profiling-based resource provisioning strategy. The idea is homogeneity in both scientific workflows and cloud resources can be exploited to remove scheduling overhead (in execution coordination) and to minimize cost meeting deadline. Our results show that our solution system can achieve 80% speed-up, by removing scheduling overhead, compared to the well-known Pegasus workflow management system when running scientific workflow ensembles. Besides, our evaluation using Montage (an astronomical image mosaic engine) workflow ensembles on around 1000-core Amazon EC2 clusters has demonstrated the efficacy of our resource provisioning strategy in terms of cost effectiveness within deadline." @default.
- W2296687957 created "2016-06-24" @default.
- W2296687957 creator A5015993565 @default.
- W2296687957 creator A5085776897 @default.
- W2296687957 creator A5091456984 @default.
- W2296687957 date "2015-09-01" @default.
- W2296687957 modified "2023-09-23" @default.
- W2296687957 title "Executing Large Scale Scientific Workflow Ensembles in Public Clouds" @default.
- W2296687957 cites W1795725 @default.
- W2296687957 cites W1996533619 @default.
- W2296687957 cites W2050569055 @default.
- W2296687957 cites W2069412423 @default.
- W2296687957 cites W2096812688 @default.
- W2296687957 cites W2101281445 @default.
- W2296687957 cites W2105083542 @default.
- W2296687957 cites W2536216700 @default.
- W2296687957 cites W2565472021 @default.
- W2296687957 cites W4251797957 @default.
- W2296687957 cites W4252427272 @default.
- W2296687957 doi "https://doi.org/10.1109/icpp.2015.61" @default.
- W2296687957 hasPublicationYear "2015" @default.
- W2296687957 type Work @default.
- W2296687957 sameAs 2296687957 @default.
- W2296687957 citedByCount "19" @default.
- W2296687957 countsByYear W22966879572015 @default.
- W2296687957 countsByYear W22966879572016 @default.
- W2296687957 countsByYear W22966879572017 @default.
- W2296687957 countsByYear W22966879572018 @default.
- W2296687957 countsByYear W22966879572019 @default.
- W2296687957 countsByYear W22966879572020 @default.
- W2296687957 countsByYear W22966879572021 @default.
- W2296687957 countsByYear W22966879572022 @default.
- W2296687957 crossrefType "proceedings-article" @default.
- W2296687957 hasAuthorship W2296687957A5015993565 @default.
- W2296687957 hasAuthorship W2296687957A5085776897 @default.
- W2296687957 hasAuthorship W2296687957A5091456984 @default.
- W2296687957 hasConcept C111919701 @default.
- W2296687957 hasConcept C121332964 @default.
- W2296687957 hasConcept C177212765 @default.
- W2296687957 hasConcept C2522767166 @default.
- W2296687957 hasConcept C2778755073 @default.
- W2296687957 hasConcept C41008148 @default.
- W2296687957 hasConcept C62520636 @default.
- W2296687957 hasConcept C77088390 @default.
- W2296687957 hasConcept C79974875 @default.
- W2296687957 hasConceptScore W2296687957C111919701 @default.
- W2296687957 hasConceptScore W2296687957C121332964 @default.
- W2296687957 hasConceptScore W2296687957C177212765 @default.
- W2296687957 hasConceptScore W2296687957C2522767166 @default.
- W2296687957 hasConceptScore W2296687957C2778755073 @default.
- W2296687957 hasConceptScore W2296687957C41008148 @default.
- W2296687957 hasConceptScore W2296687957C62520636 @default.
- W2296687957 hasConceptScore W2296687957C77088390 @default.
- W2296687957 hasConceptScore W2296687957C79974875 @default.
- W2296687957 hasLocation W22966879571 @default.
- W2296687957 hasOpenAccess W2296687957 @default.
- W2296687957 hasPrimaryLocation W22966879571 @default.
- W2296687957 hasRelatedWork W1536893558 @default.
- W2296687957 hasRelatedWork W1995129469 @default.
- W2296687957 hasRelatedWork W2275108558 @default.
- W2296687957 hasRelatedWork W2383532021 @default.
- W2296687957 hasRelatedWork W2406201540 @default.
- W2296687957 hasRelatedWork W2427429530 @default.
- W2296687957 hasRelatedWork W2895524973 @default.
- W2296687957 hasRelatedWork W3103151142 @default.
- W2296687957 hasRelatedWork W3104942604 @default.
- W2296687957 hasRelatedWork W3155433850 @default.
- W2296687957 isParatext "false" @default.
- W2296687957 isRetracted "false" @default.
- W2296687957 magId "2296687957" @default.
- W2296687957 workType "article" @default.