Matches in SemOpenAlex for { <https://semopenalex.org/work/W4384705369> ?p ?o ?g. }
Showing items 1 to 90 of
90
with 100 items per page.
- W4384705369 abstract "Graph Neural Networks (GNNs) have emerged as a very powerful and popular machine learning model for numerous application domains. Each stage of a GNN requires an aggregation (sparse matrix-matrix multiplication) and a linear operation (dense matrix-matrix multiplication). Numerous efforts have addressed the development of distributed implementations for GNNs. Although efficient algorithms for distributed matrix multiplication are well known, the challenge here is the collective optimization of sequences of distributed matrix-matrix multiplications required for GNN, where many degrees of freedom also exist in the ordering of the component matrix-multiplication operations.This paper develops a new approach to distributed GNN, ReDistribution of Matrices (RDM), centered around communication-free distributed matrix-multiplication enabled by matrix redistribution between GNN stages. While the approach is applicable to the numerous algorithmic variants of GNN, the experimental evaluation focuses on GCN (Graph Convolutional Network), including both full-batch training as well as sampling-based training using GraphSAINT. Experimental evaluation with 2-layer and 3-layer GCN, using 128 or 256 hidden features, across eight sparse datasets, on a multi-GPU system with 8 GPUs shows that RDM attains a geometric mean speedup between 2× and 3.7× over two state-of-the-art multi-GPU GCN implementations, CAGNET and DGCL." @default.
- W4384705369 created "2023-07-20" @default.
- W4384705369 creator A5012221491 @default.
- W4384705369 creator A5014159929 @default.
- W4384705369 creator A5015460842 @default.
- W4384705369 creator A5027517817 @default.
- W4384705369 creator A5043138528 @default.
- W4384705369 date "2023-05-01" @default.
- W4384705369 modified "2023-09-30" @default.
- W4384705369 title "Communication Optimization for Distributed Execution of Graph Neural Networks" @default.
- W4384705369 cites W2022704179 @default.
- W4384705369 cites W2116341502 @default.
- W4384705369 cites W2146591355 @default.
- W4384705369 cites W2789843538 @default.
- W4384705369 cites W3132185085 @default.
- W4384705369 cites W3133028082 @default.
- W4384705369 cites W3159109662 @default.
- W4384705369 cites W3159894882 @default.
- W4384705369 cites W3159953606 @default.
- W4384705369 cites W3167254314 @default.
- W4384705369 cites W3188579603 @default.
- W4384705369 cites W3206504463 @default.
- W4384705369 cites W3207203625 @default.
- W4384705369 cites W4244254628 @default.
- W4384705369 cites W4285196200 @default.
- W4384705369 cites W4292178604 @default.
- W4384705369 doi "https://doi.org/10.1109/ipdps54959.2023.00058" @default.
- W4384705369 hasPublicationYear "2023" @default.
- W4384705369 type Work @default.
- W4384705369 citedByCount "0" @default.
- W4384705369 crossrefType "proceedings-article" @default.
- W4384705369 hasAuthorship W4384705369A5012221491 @default.
- W4384705369 hasAuthorship W4384705369A5014159929 @default.
- W4384705369 hasAuthorship W4384705369A5015460842 @default.
- W4384705369 hasAuthorship W4384705369A5027517817 @default.
- W4384705369 hasAuthorship W4384705369A5043138528 @default.
- W4384705369 hasConcept C106487976 @default.
- W4384705369 hasConcept C11413529 @default.
- W4384705369 hasConcept C114614502 @default.
- W4384705369 hasConcept C121332964 @default.
- W4384705369 hasConcept C132525143 @default.
- W4384705369 hasConcept C159985019 @default.
- W4384705369 hasConcept C163716315 @default.
- W4384705369 hasConcept C17349429 @default.
- W4384705369 hasConcept C173608175 @default.
- W4384705369 hasConcept C192562407 @default.
- W4384705369 hasConcept C2780595030 @default.
- W4384705369 hasConcept C33923547 @default.
- W4384705369 hasConcept C41008148 @default.
- W4384705369 hasConcept C56372850 @default.
- W4384705369 hasConcept C62520636 @default.
- W4384705369 hasConcept C68339613 @default.
- W4384705369 hasConcept C80444323 @default.
- W4384705369 hasConcept C84114770 @default.
- W4384705369 hasConceptScore W4384705369C106487976 @default.
- W4384705369 hasConceptScore W4384705369C11413529 @default.
- W4384705369 hasConceptScore W4384705369C114614502 @default.
- W4384705369 hasConceptScore W4384705369C121332964 @default.
- W4384705369 hasConceptScore W4384705369C132525143 @default.
- W4384705369 hasConceptScore W4384705369C159985019 @default.
- W4384705369 hasConceptScore W4384705369C163716315 @default.
- W4384705369 hasConceptScore W4384705369C17349429 @default.
- W4384705369 hasConceptScore W4384705369C173608175 @default.
- W4384705369 hasConceptScore W4384705369C192562407 @default.
- W4384705369 hasConceptScore W4384705369C2780595030 @default.
- W4384705369 hasConceptScore W4384705369C33923547 @default.
- W4384705369 hasConceptScore W4384705369C41008148 @default.
- W4384705369 hasConceptScore W4384705369C56372850 @default.
- W4384705369 hasConceptScore W4384705369C62520636 @default.
- W4384705369 hasConceptScore W4384705369C68339613 @default.
- W4384705369 hasConceptScore W4384705369C80444323 @default.
- W4384705369 hasConceptScore W4384705369C84114770 @default.
- W4384705369 hasFunder F4320306076 @default.
- W4384705369 hasFunder F4320337506 @default.
- W4384705369 hasLocation W43847053691 @default.
- W4384705369 hasOpenAccess W4384705369 @default.
- W4384705369 hasPrimaryLocation W43847053691 @default.
- W4384705369 hasRelatedWork W1634487624 @default.
- W4384705369 hasRelatedWork W1948183148 @default.
- W4384705369 hasRelatedWork W1963713629 @default.
- W4384705369 hasRelatedWork W2011244049 @default.
- W4384705369 hasRelatedWork W2030992542 @default.
- W4384705369 hasRelatedWork W2120140683 @default.
- W4384705369 hasRelatedWork W2256144436 @default.
- W4384705369 hasRelatedWork W3176814699 @default.
- W4384705369 hasRelatedWork W4312354936 @default.
- W4384705369 hasRelatedWork W4366259332 @default.
- W4384705369 isParatext "false" @default.
- W4384705369 isRetracted "false" @default.
- W4384705369 workType "article" @default.