Matches in SemOpenAlex for { <https://semopenalex.org/work/W4287256116> ?p ?o ?g. }
Showing items 1 to 70 of
70
with 100 items per page.
- W4287256116 abstract "Increasing data volumes in scientific experiments necessitate the use of high-performance computing (HPC) resources for data analysis. In many scientific fields, the data generated from scientific instruments and supercomputer simulations must be analyzed rapidly. In fact, the requirement for quasi-instant feedback is growing. Scientists want to use results from one experiment to guide the selection of the next or even to improve the course of a single experiment. Current HPC systems are typically batch-scheduled under policies in which an arriving job is run immediately only if enough resources are available; otherwise, it is queued. It is hard for these systems to support real-time jobs. Real-time jobs, in order to meet their requirements, should sometimes have to preempt batch jobs and/or be scheduled ahead of batch jobs that were submitted earlier. Accommodating real-time jobs may negatively impact system utilization also, especially when preemption/restart of batch jobs is involved. We first explore several existing scheduling strategies to make real-time jobs more likely to be scheduled in due time. We then rigorously formulate the problem as a mixed-integer linear programming for offline scheduling and develop novel scheduling heuristics for online scheduling. We perform simulation studies using trace logs of Mira, the IBM BG/Q system at Argonne National Laboratory, to quantify the impact of real-time jobs on batch job performance for various percentages of real-time jobs in the workload. We present new insights gained from grouping jobs into different categories based on runtime and the number of nodes used and studying the performance of each category. Our results show that with 10% real-time job percentages, just-in-time checkpointing combined with our heuristic can improve the slowdowns of real-time jobs by 35% while limiting the increase of the slowdowns of batch jobs to 10%." @default.
- W4287256116 created "2022-07-25" @default.
- W4287256116 creator A5013494934 @default.
- W4287256116 creator A5032231503 @default.
- W4287256116 creator A5034303126 @default.
- W4287256116 creator A5068373159 @default.
- W4287256116 date "2021-03-24" @default.
- W4287256116 modified "2023-09-24" @default.
- W4287256116 title "Towards Accommodating Real-time Jobs on HPC Platforms" @default.
- W4287256116 hasPublicationYear "2021" @default.
- W4287256116 type Work @default.
- W4287256116 citedByCount "0" @default.
- W4287256116 crossrefType "posted-content" @default.
- W4287256116 hasAuthorship W4287256116A5013494934 @default.
- W4287256116 hasAuthorship W4287256116A5032231503 @default.
- W4287256116 hasAuthorship W4287256116A5034303126 @default.
- W4287256116 hasAuthorship W4287256116A5068373159 @default.
- W4287256116 hasBestOaLocation W42872561161 @default.
- W4287256116 hasConcept C111873713 @default.
- W4287256116 hasConcept C111919701 @default.
- W4287256116 hasConcept C120314980 @default.
- W4287256116 hasConcept C127413603 @default.
- W4287256116 hasConcept C127705205 @default.
- W4287256116 hasConcept C171250308 @default.
- W4287256116 hasConcept C171627638 @default.
- W4287256116 hasConcept C172658912 @default.
- W4287256116 hasConcept C192562407 @default.
- W4287256116 hasConcept C206729178 @default.
- W4287256116 hasConcept C206952183 @default.
- W4287256116 hasConcept C21547014 @default.
- W4287256116 hasConcept C2778476105 @default.
- W4287256116 hasConcept C41008148 @default.
- W4287256116 hasConcept C70388272 @default.
- W4287256116 hasConcept C79403827 @default.
- W4287256116 hasConcept C79974875 @default.
- W4287256116 hasConcept C83283714 @default.
- W4287256116 hasConceptScore W4287256116C111873713 @default.
- W4287256116 hasConceptScore W4287256116C111919701 @default.
- W4287256116 hasConceptScore W4287256116C120314980 @default.
- W4287256116 hasConceptScore W4287256116C127413603 @default.
- W4287256116 hasConceptScore W4287256116C127705205 @default.
- W4287256116 hasConceptScore W4287256116C171250308 @default.
- W4287256116 hasConceptScore W4287256116C171627638 @default.
- W4287256116 hasConceptScore W4287256116C172658912 @default.
- W4287256116 hasConceptScore W4287256116C192562407 @default.
- W4287256116 hasConceptScore W4287256116C206729178 @default.
- W4287256116 hasConceptScore W4287256116C206952183 @default.
- W4287256116 hasConceptScore W4287256116C21547014 @default.
- W4287256116 hasConceptScore W4287256116C2778476105 @default.
- W4287256116 hasConceptScore W4287256116C41008148 @default.
- W4287256116 hasConceptScore W4287256116C70388272 @default.
- W4287256116 hasConceptScore W4287256116C79403827 @default.
- W4287256116 hasConceptScore W4287256116C79974875 @default.
- W4287256116 hasConceptScore W4287256116C83283714 @default.
- W4287256116 hasLocation W42872561161 @default.
- W4287256116 hasOpenAccess W4287256116 @default.
- W4287256116 hasPrimaryLocation W42872561161 @default.
- W4287256116 hasRelatedWork W11020796 @default.
- W4287256116 hasRelatedWork W12032772 @default.
- W4287256116 hasRelatedWork W14862478 @default.
- W4287256116 hasRelatedWork W1987664 @default.
- W4287256116 hasRelatedWork W3127862 @default.
- W4287256116 hasRelatedWork W5402048 @default.
- W4287256116 hasRelatedWork W5980533 @default.
- W4287256116 hasRelatedWork W6091351 @default.
- W4287256116 hasRelatedWork W7756650 @default.
- W4287256116 hasRelatedWork W916585 @default.
- W4287256116 isParatext "false" @default.
- W4287256116 isRetracted "false" @default.
- W4287256116 workType "article" @default.