Matches in SemOpenAlex for { <https://semopenalex.org/work/W2909658518> ?p ?o ?g. }
Showing items 1 to 81 of
81
with 100 items per page.
- W2909658518 abstract "In this thesis we present a novel simulation workflow to evaluate the performance of dynamic load balancing with over-decomposition applied to iterative parallel applications at low-cost. Its goals are to perform such evaluation with minimal application modification and at a low cost in terms of time and of resource requirements. Many parallel applications suffer from dynamic (temporal) load imbalance that can not be treated at the application level. It may be caused by intrinsic characteristics of the application or by external software and hardware factors. As demonstrated in this thesis, such dynamic imbalance can be found even in applications whose codes do not hint at any dynamism. Therefore, we need to rely on runtime dynamic load balancing mechanisms, such as dynamic load balancing based on over-decomposition. The problem is that evaluating and tuning the performance of such technique can be costly. This usually entails modifications to the application and a large number of executions to get statistically sound performance measurements with different load balancing parameter combinations. Moreover, useful and accurate measurements often require big resource allocations on a production cluster. Our simulation workflow, dubbed Simulated Adaptive MPI (SAMPI), employs a combined sequential emulation and trace-replay simulation approach to reduce the cost of such an evaluation. Both sequential emulation and trace-replay require a single computer node. Additionally, the trace-replay simulation lasts a small fraction of the real-life parallel execution time of the application. Besides the basic SAMPI simulation, we developed spatial aggregation and application-level rescaling techniques to speed-up the emulation process. To demonstrate the real-life performance benefits of dynamic load balance with over-decomposition, we evaluated the performance gains obtained by employing this technique on a iterative parallel geophysics application, called Ondes3D. Dynamic load balancing support was provided by Adaptive MPI (AMPI). This resulted in up to 36.58% performance improvement, on 288 cores of a cluster. This real-life evaluation also illustrates the difficulties found in this process, thus justifying the use of simulation. To implement the SAMPI workflow, we relied on SimGrid’s Simulated MPI (SMPI) interface in both emulation and trace-replay modes. To validate our simulator, we compared simulated (SAMPI) and real-life (AMPI) executions of Ondes3D. The simulations presented a load balance evolution very similar to real-life and were also successful in choosing the best load balancing heuristic for each scenario. Besides the validation, we demonstrate the use of SAMPI for load balancing parameter exploration and for computational capacity planning. As for the performance of the simulation itself, we roughly estimate that our full workflow can simulate the execution of Ondes3D with 24 different load balancing parameter combinations in ≈ 5 hours for our heavier earthquake scenario and in ≈ 3 hours for the lighter one." @default.
- W2909658518 created "2019-01-25" @default.
- W2909658518 creator A5085376000 @default.
- W2909658518 date "2018-04-26" @default.
- W2909658518 modified "2023-09-27" @default.
- W2909658518 title "A simulation workflow to evaluate the performance of dynamic load balancing with over decomposition for iterative parallel applications" @default.
- W2909658518 hasPublicationYear "2018" @default.
- W2909658518 type Work @default.
- W2909658518 sameAs 2909658518 @default.
- W2909658518 citedByCount "0" @default.
- W2909658518 crossrefType "dissertation" @default.
- W2909658518 hasAuthorship W2909658518A5085376000 @default.
- W2909658518 hasConcept C120314980 @default.
- W2909658518 hasConcept C121332964 @default.
- W2909658518 hasConcept C138885662 @default.
- W2909658518 hasConcept C138959212 @default.
- W2909658518 hasConcept C149810388 @default.
- W2909658518 hasConcept C162324750 @default.
- W2909658518 hasConcept C173608175 @default.
- W2909658518 hasConcept C177212765 @default.
- W2909658518 hasConcept C187691185 @default.
- W2909658518 hasConcept C199360897 @default.
- W2909658518 hasConcept C2524010 @default.
- W2909658518 hasConcept C2775836275 @default.
- W2909658518 hasConcept C2777904410 @default.
- W2909658518 hasConcept C33923547 @default.
- W2909658518 hasConcept C41008148 @default.
- W2909658518 hasConcept C41895202 @default.
- W2909658518 hasConcept C50522688 @default.
- W2909658518 hasConcept C62520636 @default.
- W2909658518 hasConcept C75291252 @default.
- W2909658518 hasConcept C77088390 @default.
- W2909658518 hasConcept C79403827 @default.
- W2909658518 hasConceptScore W2909658518C120314980 @default.
- W2909658518 hasConceptScore W2909658518C121332964 @default.
- W2909658518 hasConceptScore W2909658518C138885662 @default.
- W2909658518 hasConceptScore W2909658518C138959212 @default.
- W2909658518 hasConceptScore W2909658518C149810388 @default.
- W2909658518 hasConceptScore W2909658518C162324750 @default.
- W2909658518 hasConceptScore W2909658518C173608175 @default.
- W2909658518 hasConceptScore W2909658518C177212765 @default.
- W2909658518 hasConceptScore W2909658518C187691185 @default.
- W2909658518 hasConceptScore W2909658518C199360897 @default.
- W2909658518 hasConceptScore W2909658518C2524010 @default.
- W2909658518 hasConceptScore W2909658518C2775836275 @default.
- W2909658518 hasConceptScore W2909658518C2777904410 @default.
- W2909658518 hasConceptScore W2909658518C33923547 @default.
- W2909658518 hasConceptScore W2909658518C41008148 @default.
- W2909658518 hasConceptScore W2909658518C41895202 @default.
- W2909658518 hasConceptScore W2909658518C50522688 @default.
- W2909658518 hasConceptScore W2909658518C62520636 @default.
- W2909658518 hasConceptScore W2909658518C75291252 @default.
- W2909658518 hasConceptScore W2909658518C77088390 @default.
- W2909658518 hasConceptScore W2909658518C79403827 @default.
- W2909658518 hasLocation W29096585181 @default.
- W2909658518 hasOpenAccess W2909658518 @default.
- W2909658518 hasPrimaryLocation W29096585181 @default.
- W2909658518 hasRelatedWork W1619846826 @default.
- W2909658518 hasRelatedWork W1916653100 @default.
- W2909658518 hasRelatedWork W1994469476 @default.
- W2909658518 hasRelatedWork W2032060964 @default.
- W2909658518 hasRelatedWork W2032466878 @default.
- W2909658518 hasRelatedWork W2085130642 @default.
- W2909658518 hasRelatedWork W2102624126 @default.
- W2909658518 hasRelatedWork W2115729180 @default.
- W2909658518 hasRelatedWork W2246067240 @default.
- W2909658518 hasRelatedWork W2491953944 @default.
- W2909658518 hasRelatedWork W2504216167 @default.
- W2909658518 hasRelatedWork W2504829434 @default.
- W2909658518 hasRelatedWork W2584202318 @default.
- W2909658518 hasRelatedWork W2791703188 @default.
- W2909658518 hasRelatedWork W2886166961 @default.
- W2909658518 hasRelatedWork W2898719271 @default.
- W2909658518 hasRelatedWork W2944563677 @default.
- W2909658518 hasRelatedWork W3038124209 @default.
- W2909658518 hasRelatedWork W3115792420 @default.
- W2909658518 hasRelatedWork W3021740775 @default.
- W2909658518 isParatext "false" @default.
- W2909658518 isRetracted "false" @default.
- W2909658518 magId "2909658518" @default.
- W2909658518 workType "dissertation" @default.