Matches in SemOpenAlex for { <https://semopenalex.org/work/W2083801760> ?p ?o ?g. }
Showing items 1 to 100 of
100
with 100 items per page.
- W2083801760 endingPage "1283" @default.
- W2083801760 startingPage "1261" @default.
- W2083801760 abstract "Abstract In high‐performance computing (HPC)textitworkloads (i.e. the set of computations to be completed), the same computational workflow of jobs (e.g. a Pipeline, a Fork&Join, or a Lattice graph) may be applied to different input files and parameters. Each of these workflow instances has the same workflow shape, but accesses (possibly) separate input, intermediate, and output files. Therefore, the selective isolation of each workflow instance can be important for maximizing scheduling flexibility and performance. However, in practice, realizing this benefit is not obvious due to a variety of problems and constraints. For example, the unmediated interaction of different workflow instances can lead to a problem of filename conflicts between concurrent workflow instances overwriting common files, which, for a control‐flow driven batch scheduler, may result in either unsafe computation of the multiple instances in the same sub‐directory or storage overheads when multiple directories are used. We propose a novel approach of selectively coupling and integrating job schedulers and file systems, known as a Workflow‐aware File System (WaFS), with two major benefits. First, separate namespaces can be constructed on a per‐instance basis to maximize the concurrency of workflow instances, despite filename conflicts, while minimizing storage overhead. Second, exploiting inferred dataflow information, trade‐offs can be made between makespan and storage overhead while maintaining correctness. Through a simulation‐based study, we have shown the potential benefits of WaFS to job concurrency and we have characterized the trade‐offs that can be made between storage overhead and performance. New scheduling policies, Versioned Namespace (VNS) , Overwrite‐Safe Concurrency (OSC) and hybrids, are made possible by WaFS, with different advantages and disadvantages. Copyright © 2011 John Wiley & Sons, Ltd." @default.
- W2083801760 created "2016-06-24" @default.
- W2083801760 creator A5003642180 @default.
- W2083801760 creator A5022652713 @default.
- W2083801760 date "2011-04-25" @default.
- W2083801760 modified "2023-10-17" @default.
- W2083801760 title "Dataflow detection and applications to workflow scheduling" @default.
- W2083801760 cites W1983833794 @default.
- W2083801760 cites W1996650713 @default.
- W2083801760 cites W2017855273 @default.
- W2083801760 cites W2019447492 @default.
- W2083801760 cites W2022950330 @default.
- W2083801760 cites W2027960051 @default.
- W2083801760 cites W2030565040 @default.
- W2083801760 cites W2050952165 @default.
- W2083801760 cites W2055951513 @default.
- W2083801760 cites W2061340679 @default.
- W2083801760 cites W2097829252 @default.
- W2083801760 cites W2109033701 @default.
- W2083801760 cites W2129666400 @default.
- W2083801760 cites W2149027035 @default.
- W2083801760 cites W2150408357 @default.
- W2083801760 cites W2150511069 @default.
- W2083801760 cites W2153829863 @default.
- W2083801760 cites W2154886374 @default.
- W2083801760 cites W2157901295 @default.
- W2083801760 cites W2164304411 @default.
- W2083801760 cites W2168544140 @default.
- W2083801760 cites W2169040626 @default.
- W2083801760 cites W2171532807 @default.
- W2083801760 cites W3010320449 @default.
- W2083801760 cites W4237328017 @default.
- W2083801760 cites W4238584892 @default.
- W2083801760 cites W4239429564 @default.
- W2083801760 cites W4240497345 @default.
- W2083801760 cites W4245935557 @default.
- W2083801760 cites W4256398516 @default.
- W2083801760 doi "https://doi.org/10.1002/cpe.1708" @default.
- W2083801760 hasPublicationYear "2011" @default.
- W2083801760 type Work @default.
- W2083801760 sameAs 2083801760 @default.
- W2083801760 citedByCount "13" @default.
- W2083801760 countsByYear W20838017602013 @default.
- W2083801760 countsByYear W20838017602014 @default.
- W2083801760 countsByYear W20838017602015 @default.
- W2083801760 countsByYear W20838017602017 @default.
- W2083801760 countsByYear W20838017602022 @default.
- W2083801760 countsByYear W20838017602023 @default.
- W2083801760 crossrefType "journal-article" @default.
- W2083801760 hasAuthorship W2083801760A5003642180 @default.
- W2083801760 hasAuthorship W2083801760A5022652713 @default.
- W2083801760 hasConcept C11413529 @default.
- W2083801760 hasConcept C120314980 @default.
- W2083801760 hasConcept C140824633 @default.
- W2083801760 hasConcept C162324750 @default.
- W2083801760 hasConcept C173608175 @default.
- W2083801760 hasConcept C177212765 @default.
- W2083801760 hasConcept C193702766 @default.
- W2083801760 hasConcept C19612761 @default.
- W2083801760 hasConcept C206729178 @default.
- W2083801760 hasConcept C21547014 @default.
- W2083801760 hasConcept C41008148 @default.
- W2083801760 hasConcept C55439883 @default.
- W2083801760 hasConcept C77088390 @default.
- W2083801760 hasConcept C96324660 @default.
- W2083801760 hasConceptScore W2083801760C11413529 @default.
- W2083801760 hasConceptScore W2083801760C120314980 @default.
- W2083801760 hasConceptScore W2083801760C140824633 @default.
- W2083801760 hasConceptScore W2083801760C162324750 @default.
- W2083801760 hasConceptScore W2083801760C173608175 @default.
- W2083801760 hasConceptScore W2083801760C177212765 @default.
- W2083801760 hasConceptScore W2083801760C193702766 @default.
- W2083801760 hasConceptScore W2083801760C19612761 @default.
- W2083801760 hasConceptScore W2083801760C206729178 @default.
- W2083801760 hasConceptScore W2083801760C21547014 @default.
- W2083801760 hasConceptScore W2083801760C41008148 @default.
- W2083801760 hasConceptScore W2083801760C55439883 @default.
- W2083801760 hasConceptScore W2083801760C77088390 @default.
- W2083801760 hasConceptScore W2083801760C96324660 @default.
- W2083801760 hasIssue "11" @default.
- W2083801760 hasLocation W20838017601 @default.
- W2083801760 hasOpenAccess W2083801760 @default.
- W2083801760 hasPrimaryLocation W20838017601 @default.
- W2083801760 hasRelatedWork W2155606843 @default.
- W2083801760 hasRelatedWork W2352344200 @default.
- W2083801760 hasRelatedWork W2365658322 @default.
- W2083801760 hasRelatedWork W2373541195 @default.
- W2083801760 hasRelatedWork W2375552622 @default.
- W2083801760 hasRelatedWork W2376410910 @default.
- W2083801760 hasRelatedWork W2379425324 @default.
- W2083801760 hasRelatedWork W2385499106 @default.
- W2083801760 hasRelatedWork W2391168633 @default.
- W2083801760 hasRelatedWork W291310304 @default.
- W2083801760 hasVolume "23" @default.
- W2083801760 isParatext "false" @default.
- W2083801760 isRetracted "false" @default.
- W2083801760 magId "2083801760" @default.
- W2083801760 workType "article" @default.