Matches in SemOpenAlex for { <https://semopenalex.org/work/W4200511892> ?p ?o ?g. }
Showing items 1 to 91 of
91
with 100 items per page.
- W4200511892 abstract "In-situ processing alleviates the gap between computation and I/O capabilities by performing data analysis close to the data source. With simulation data varying in size and content during workflow execution, it becomes necessary for insitu processing to support resource elasticity, i.e., the ability to change resource configurations such as the number of computing nodes/processes during workflow execution. An elastic job may dynamically adjust resource configurations; it may use a few resources at the beginning and more resources towards the end of the job when interesting data appears. However, it is hard to predict a priori how many computing nodes/processes need to be added/removed during the workflow execution to adapt to changing workflow needs. How to efficiently guide elasticity operations, such as growing or shrinking the number of processes used for in-situ analysis during workflow execution, is an open-ended research question. In this paper, we present an adaptive elasticity policy that adopts workflow runtime information collected online to predict how to trigger the addition and removal of processes in order to minimize in-situ processing overheads. We integrate the presented elasticity policy into a staging-based elastic workflow and evaluate its efficiency in multiple elasticity scenarios. The results indicate that an adaptive elasticity policy can save overhead in finding a proper resource configuration, when compared with a static policy that uses a fixed number of processes for each rescaling operation. Finally, we discuss multiple existing research opportunities of elastic insitu processing from different aspects." @default.
- W4200511892 created "2021-12-31" @default.
- W4200511892 creator A5005233695 @default.
- W4200511892 creator A5017578031 @default.
- W4200511892 creator A5056053058 @default.
- W4200511892 creator A5060153432 @default.
- W4200511892 creator A5070907426 @default.
- W4200511892 date "2021-11-01" @default.
- W4200511892 modified "2023-09-23" @default.
- W4200511892 title "An Adaptive Elasticity Policy For Staging Based In-Situ Processing" @default.
- W4200511892 cites W1980853116 @default.
- W4200511892 cites W1981812667 @default.
- W4200511892 cites W2044010008 @default.
- W4200511892 cites W2069942003 @default.
- W4200511892 cites W2099973502 @default.
- W4200511892 cites W2108648154 @default.
- W4200511892 cites W2128577831 @default.
- W4200511892 cites W2150214994 @default.
- W4200511892 cites W2151585159 @default.
- W4200511892 cites W2301545354 @default.
- W4200511892 cites W2507758807 @default.
- W4200511892 cites W2532284696 @default.
- W4200511892 cites W2623744461 @default.
- W4200511892 cites W2746733957 @default.
- W4200511892 cites W2766700272 @default.
- W4200511892 cites W2972080272 @default.
- W4200511892 cites W3004004277 @default.
- W4200511892 cites W3033679806 @default.
- W4200511892 cites W3035074910 @default.
- W4200511892 cites W3044758135 @default.
- W4200511892 cites W3049310812 @default.
- W4200511892 cites W3103362336 @default.
- W4200511892 cites W3159546114 @default.
- W4200511892 cites W2794609069 @default.
- W4200511892 cites W2969908327 @default.
- W4200511892 cites W2984301305 @default.
- W4200511892 doi "https://doi.org/10.1109/works54523.2021.00010" @default.
- W4200511892 hasPublicationYear "2021" @default.
- W4200511892 type Work @default.
- W4200511892 citedByCount "2" @default.
- W4200511892 countsByYear W42005118922022 @default.
- W4200511892 crossrefType "proceedings-article" @default.
- W4200511892 hasAuthorship W4200511892A5005233695 @default.
- W4200511892 hasAuthorship W4200511892A5017578031 @default.
- W4200511892 hasAuthorship W4200511892A5056053058 @default.
- W4200511892 hasAuthorship W4200511892A5060153432 @default.
- W4200511892 hasAuthorship W4200511892A5070907426 @default.
- W4200511892 hasConcept C111472728 @default.
- W4200511892 hasConcept C111919701 @default.
- W4200511892 hasConcept C11413529 @default.
- W4200511892 hasConcept C120314980 @default.
- W4200511892 hasConcept C121854251 @default.
- W4200511892 hasConcept C138885662 @default.
- W4200511892 hasConcept C159985019 @default.
- W4200511892 hasConcept C177212765 @default.
- W4200511892 hasConcept C192562407 @default.
- W4200511892 hasConcept C2779960059 @default.
- W4200511892 hasConcept C41008148 @default.
- W4200511892 hasConcept C45374587 @default.
- W4200511892 hasConcept C75553542 @default.
- W4200511892 hasConcept C77088390 @default.
- W4200511892 hasConceptScore W4200511892C111472728 @default.
- W4200511892 hasConceptScore W4200511892C111919701 @default.
- W4200511892 hasConceptScore W4200511892C11413529 @default.
- W4200511892 hasConceptScore W4200511892C120314980 @default.
- W4200511892 hasConceptScore W4200511892C121854251 @default.
- W4200511892 hasConceptScore W4200511892C138885662 @default.
- W4200511892 hasConceptScore W4200511892C159985019 @default.
- W4200511892 hasConceptScore W4200511892C177212765 @default.
- W4200511892 hasConceptScore W4200511892C192562407 @default.
- W4200511892 hasConceptScore W4200511892C2779960059 @default.
- W4200511892 hasConceptScore W4200511892C41008148 @default.
- W4200511892 hasConceptScore W4200511892C45374587 @default.
- W4200511892 hasConceptScore W4200511892C75553542 @default.
- W4200511892 hasConceptScore W4200511892C77088390 @default.
- W4200511892 hasLocation W42005118921 @default.
- W4200511892 hasOpenAccess W4200511892 @default.
- W4200511892 hasPrimaryLocation W42005118921 @default.
- W4200511892 hasRelatedWork W2092071486 @default.
- W4200511892 hasRelatedWork W2131630752 @default.
- W4200511892 hasRelatedWork W2391167130 @default.
- W4200511892 hasRelatedWork W2522621823 @default.
- W4200511892 hasRelatedWork W2964552794 @default.
- W4200511892 hasRelatedWork W3206324740 @default.
- W4200511892 hasRelatedWork W4200511892 @default.
- W4200511892 hasRelatedWork W4242263690 @default.
- W4200511892 hasRelatedWork W4242952987 @default.
- W4200511892 hasRelatedWork W4283067488 @default.
- W4200511892 isParatext "false" @default.
- W4200511892 isRetracted "false" @default.
- W4200511892 workType "article" @default.