Matches in SemOpenAlex for { <https://semopenalex.org/work/W2336220827> ?p ?o ?g. }
Showing items 1 to 75 of
75
with 100 items per page.
- W2336220827 abstract "In the world of parallel programming, there are two major classes of programming models: shared memory and distributed memory. Shared memory models share all memory by default, and are most effective on multi-processor systems. Distributed memory models separate memory into distinct regions for each execution context and are most effective on a network of processors. Modern and future High Performance Computing (HPC) systems will contain multi- and many-core processors connected by a network, resulting in a hybrid shared and distributed memory environment. Neither programming model is ideal in both areas. Now and in the future, optimizing parallel performance for both memory models simultaneously is a major challenge. MPI (Message Passing Interface) is the de-facto standard for distributed memory programming, but results in less than ideal performance when used in a shared memory environment. Message passing incurs overhead in the form of unnecessary data copying as well specific queuing, ordering, and matching rules. In this thesis, we will present a series of techniques that optimize MPI performance in a shared memory environment, thus helping to solve the challenge of optimizing parallel performance for both distributed and shared memory. We introduce the concept of a shared memory heap, in which dynamically allocated memory is shared by default on all MPI processes within a node. We then use that to transparently optimize message passing with two new data transfer protocols. Next, we propose an MPI extension for ownership passing, which eliminates data copying overheads completely. Instead of copying data, we transfer control (ownership) of communication buffers. Finally, we explore how shared memory techniques can be applied in the context of MPI and the shared memory heap. Loop fusion is a new technique for combining the packing and unpacking code on two different MPI ranks to eliminate explicit communication. All of these techniques are implemented in a freely available software library named Hybrid MPI (HMPI). We experimentally evaluate our work using a variety of micro-benchmarks and mini-applications. In the mini-applications, communication performance is improved up to 46% by our data transfer protocols, 54% by ownership passing, and 63% by loop fusion." @default.
- W2336220827 created "2016-06-24" @default.
- W2336220827 creator A5000867808 @default.
- W2336220827 creator A5034962826 @default.
- W2336220827 date "2013-01-01" @default.
- W2336220827 modified "2023-09-26" @default.
- W2336220827 title "Shared memory optimizations for distributed memory programming models" @default.
- W2336220827 hasPublicationYear "2013" @default.
- W2336220827 type Work @default.
- W2336220827 sameAs 2336220827 @default.
- W2336220827 citedByCount "0" @default.
- W2336220827 crossrefType "journal-article" @default.
- W2336220827 hasAuthorship W2336220827A5000867808 @default.
- W2336220827 hasAuthorship W2336220827A5034962826 @default.
- W2336220827 hasConcept C111919701 @default.
- W2336220827 hasConcept C120314980 @default.
- W2336220827 hasConcept C12186640 @default.
- W2336220827 hasConcept C133875982 @default.
- W2336220827 hasConcept C173608175 @default.
- W2336220827 hasConcept C176649486 @default.
- W2336220827 hasConcept C180089779 @default.
- W2336220827 hasConcept C199360897 @default.
- W2336220827 hasConcept C34165917 @default.
- W2336220827 hasConcept C39528615 @default.
- W2336220827 hasConcept C41008148 @default.
- W2336220827 hasConcept C51290061 @default.
- W2336220827 hasConcept C63511323 @default.
- W2336220827 hasConcept C74426580 @default.
- W2336220827 hasConcept C854659 @default.
- W2336220827 hasConcept C91481028 @default.
- W2336220827 hasConcept C98986596 @default.
- W2336220827 hasConceptScore W2336220827C111919701 @default.
- W2336220827 hasConceptScore W2336220827C120314980 @default.
- W2336220827 hasConceptScore W2336220827C12186640 @default.
- W2336220827 hasConceptScore W2336220827C133875982 @default.
- W2336220827 hasConceptScore W2336220827C173608175 @default.
- W2336220827 hasConceptScore W2336220827C176649486 @default.
- W2336220827 hasConceptScore W2336220827C180089779 @default.
- W2336220827 hasConceptScore W2336220827C199360897 @default.
- W2336220827 hasConceptScore W2336220827C34165917 @default.
- W2336220827 hasConceptScore W2336220827C39528615 @default.
- W2336220827 hasConceptScore W2336220827C41008148 @default.
- W2336220827 hasConceptScore W2336220827C51290061 @default.
- W2336220827 hasConceptScore W2336220827C63511323 @default.
- W2336220827 hasConceptScore W2336220827C74426580 @default.
- W2336220827 hasConceptScore W2336220827C854659 @default.
- W2336220827 hasConceptScore W2336220827C91481028 @default.
- W2336220827 hasConceptScore W2336220827C98986596 @default.
- W2336220827 hasLocation W23362208271 @default.
- W2336220827 hasOpenAccess W2336220827 @default.
- W2336220827 hasPrimaryLocation W23362208271 @default.
- W2336220827 hasRelatedWork W1483941147 @default.
- W2336220827 hasRelatedWork W1512842870 @default.
- W2336220827 hasRelatedWork W1530014183 @default.
- W2336220827 hasRelatedWork W1553983593 @default.
- W2336220827 hasRelatedWork W1572624911 @default.
- W2336220827 hasRelatedWork W1583246763 @default.
- W2336220827 hasRelatedWork W1601928317 @default.
- W2336220827 hasRelatedWork W161571474 @default.
- W2336220827 hasRelatedWork W174345947 @default.
- W2336220827 hasRelatedWork W2078898826 @default.
- W2336220827 hasRelatedWork W2100308885 @default.
- W2336220827 hasRelatedWork W2109997314 @default.
- W2336220827 hasRelatedWork W2114827297 @default.
- W2336220827 hasRelatedWork W2134107175 @default.
- W2336220827 hasRelatedWork W2146375161 @default.
- W2336220827 hasRelatedWork W2149770289 @default.
- W2336220827 hasRelatedWork W2314805133 @default.
- W2336220827 hasRelatedWork W2805219693 @default.
- W2336220827 hasRelatedWork W3172966190 @default.
- W2336220827 hasRelatedWork W184932080 @default.
- W2336220827 isParatext "false" @default.
- W2336220827 isRetracted "false" @default.
- W2336220827 magId "2336220827" @default.
- W2336220827 workType "article" @default.