Matches in SemOpenAlex for { <https://semopenalex.org/work/W2484869078> ?p ?o ?g. }
Showing items 1 to 96 of
96
with 100 items per page.
- W2484869078 abstract "Hadoop and Spark analytics are used widely for large-scale data processing on commodity clusters. It is better choice to run them on supercomputers in aspects of productivity and maturity rather than developing new frameworks from scratch. YARN, a key component of Hadoop, is responsible for resource management. YARN adopts dynamic management for job execution and scheduling. We identify three Ds (3D) dynamic characteristics from YARN-like management: on-Demand (processes created during job execution), Diverse job, and Detailed (fine-grained allocation). The dynamic management does not fit into typical resource managers on supercomputers, for example PBS, that are identified having three Ss (3S) static characteristics: Stationary (no newly created process during execution), Single job, and Shallow (coarse-grained allocation). In this paper, we propose HPC-Reuse located between YARN-like and PBS-like resource managers in order to provide better support of dynamic management. HPC-Reuse helps avoid process creation, such as MPI-Spawn, and enable MPI communication over Hadoop processes. Our experimental results show that HPC-Reuse can reduce execution time of iterative PageRank by 26%." @default.
- W2484869078 created "2016-08-23" @default.
- W2484869078 creator A5010642200 @default.
- W2484869078 creator A5026542200 @default.
- W2484869078 date "2016-05-01" @default.
- W2484869078 modified "2023-10-01" @default.
- W2484869078 title "HPC-Reuse: Efficient Process Creation for Running MPI and Hadoop MapReduce on Supercomputers" @default.
- W2484869078 cites W1596936080 @default.
- W2484869078 cites W1598064945 @default.
- W2484869078 cites W2049644498 @default.
- W2484869078 cites W2050123813 @default.
- W2484869078 cites W2060617594 @default.
- W2484869078 cites W2105947650 @default.
- W2484869078 cites W2158535916 @default.
- W2484869078 cites W2163961697 @default.
- W2484869078 cites W2187125920 @default.
- W2484869078 cites W2189465200 @default.
- W2484869078 doi "https://doi.org/10.1109/ccgrid.2016.72" @default.
- W2484869078 hasPublicationYear "2016" @default.
- W2484869078 type Work @default.
- W2484869078 sameAs 2484869078 @default.
- W2484869078 citedByCount "6" @default.
- W2484869078 countsByYear W24848690782017 @default.
- W2484869078 countsByYear W24848690782018 @default.
- W2484869078 countsByYear W24848690782019 @default.
- W2484869078 countsByYear W24848690782020 @default.
- W2484869078 crossrefType "proceedings-article" @default.
- W2484869078 hasAuthorship W2484869078A5010642200 @default.
- W2484869078 hasAuthorship W2484869078A5026542200 @default.
- W2484869078 hasConcept C111873713 @default.
- W2484869078 hasConcept C111919701 @default.
- W2484869078 hasConcept C120314980 @default.
- W2484869078 hasConcept C159985019 @default.
- W2484869078 hasConcept C162324750 @default.
- W2484869078 hasConcept C171627638 @default.
- W2484869078 hasConcept C173608175 @default.
- W2484869078 hasConcept C18903297 @default.
- W2484869078 hasConcept C192562407 @default.
- W2484869078 hasConcept C206588197 @default.
- W2484869078 hasConcept C206729178 @default.
- W2484869078 hasConcept C21547014 @default.
- W2484869078 hasConcept C2778787235 @default.
- W2484869078 hasConcept C41008148 @default.
- W2484869078 hasConcept C75684735 @default.
- W2484869078 hasConcept C77088390 @default.
- W2484869078 hasConcept C79158427 @default.
- W2484869078 hasConcept C79974875 @default.
- W2484869078 hasConcept C86803240 @default.
- W2484869078 hasConcept C98045186 @default.
- W2484869078 hasConceptScore W2484869078C111873713 @default.
- W2484869078 hasConceptScore W2484869078C111919701 @default.
- W2484869078 hasConceptScore W2484869078C120314980 @default.
- W2484869078 hasConceptScore W2484869078C159985019 @default.
- W2484869078 hasConceptScore W2484869078C162324750 @default.
- W2484869078 hasConceptScore W2484869078C171627638 @default.
- W2484869078 hasConceptScore W2484869078C173608175 @default.
- W2484869078 hasConceptScore W2484869078C18903297 @default.
- W2484869078 hasConceptScore W2484869078C192562407 @default.
- W2484869078 hasConceptScore W2484869078C206588197 @default.
- W2484869078 hasConceptScore W2484869078C206729178 @default.
- W2484869078 hasConceptScore W2484869078C21547014 @default.
- W2484869078 hasConceptScore W2484869078C2778787235 @default.
- W2484869078 hasConceptScore W2484869078C41008148 @default.
- W2484869078 hasConceptScore W2484869078C75684735 @default.
- W2484869078 hasConceptScore W2484869078C77088390 @default.
- W2484869078 hasConceptScore W2484869078C79158427 @default.
- W2484869078 hasConceptScore W2484869078C79974875 @default.
- W2484869078 hasConceptScore W2484869078C86803240 @default.
- W2484869078 hasConceptScore W2484869078C98045186 @default.
- W2484869078 hasLocation W24848690781 @default.
- W2484869078 hasOpenAccess W2484869078 @default.
- W2484869078 hasPrimaryLocation W24848690781 @default.
- W2484869078 hasRelatedWork W1490404085 @default.
- W2484869078 hasRelatedWork W1528652782 @default.
- W2484869078 hasRelatedWork W1794174336 @default.
- W2484869078 hasRelatedWork W1831229313 @default.
- W2484869078 hasRelatedWork W1904349858 @default.
- W2484869078 hasRelatedWork W1953597186 @default.
- W2484869078 hasRelatedWork W2000666938 @default.
- W2484869078 hasRelatedWork W2026766278 @default.
- W2484869078 hasRelatedWork W2102840489 @default.
- W2484869078 hasRelatedWork W2105947650 @default.
- W2484869078 hasRelatedWork W2156512349 @default.
- W2484869078 hasRelatedWork W2517777114 @default.
- W2484869078 hasRelatedWork W2542287397 @default.
- W2484869078 hasRelatedWork W2730660683 @default.
- W2484869078 hasRelatedWork W2762095821 @default.
- W2484869078 hasRelatedWork W2793887942 @default.
- W2484869078 hasRelatedWork W2991076415 @default.
- W2484869078 hasRelatedWork W3109856881 @default.
- W2484869078 hasRelatedWork W807592880 @default.
- W2484869078 hasRelatedWork W2183014094 @default.
- W2484869078 isParatext "false" @default.
- W2484869078 isRetracted "false" @default.
- W2484869078 magId "2484869078" @default.
- W2484869078 workType "article" @default.