Matches in SemOpenAlex for { <https://semopenalex.org/work/W2113338557> ?p ?o ?g. }
- W2113338557 abstract "This paper derives tradeoffs between three basic costs of a parallel algorithm: synchronization, data movement, and computational cost. These tradeoffs are lower bounds on the execution time of the algorithm which are independent of the number of processors, but dependent on the problem size. Therefore, they provide lower bounds on the parallel execution time of any algorithm computed by a system composed of any number of homogeneous components, each with associated computational, communication, and synchronization payloads. We employ a theoretical model counts the amount of work and data movement as a maximum of any execution path during the parallel computation. By considering this metric, rather than the total communication volume over the whole machine, we obtain new insights into the characteristics of parallel schedules for algorithms with non-trivial dependency structures. We also present reductions from BSP and LogP algorithms to our execution model, extending our lower bounds to these two models of parallel computation. We first develop our results for general dependency graphs and hypergraphs based on their expansion properties, then we apply the theorem to a number of specific algorithms in numerical linear algebra, namely triangular substitution, Gaussian elimination, and Krylov subspace methods. Our lower bound for LU factorization demonstrates the optimality of Tiskin's LU algorithm answering an open question posed in his paper, as well as of the 2.5D LU algorithm which has analogous costs. We treat the computations in a general manner by noting that the computations share a similar dependency hypergraph structure and analyzing the communication requirements of lattice hypergraph structures." @default.
- W2113338557 created "2016-06-24" @default.
- W2113338557 creator A5022838370 @default.
- W2113338557 creator A5072265294 @default.
- W2113338557 creator A5076825233 @default.
- W2113338557 creator A5078588702 @default.
- W2113338557 date "2014-06-21" @default.
- W2113338557 modified "2023-10-14" @default.
- W2113338557 title "Tradeoffs between synchronization, communication, and computation in parallel linear algebra computations" @default.
- W2113338557 cites W1972501001 @default.
- W2113338557 cites W1978723563 @default.
- W2113338557 cites W1985004065 @default.
- W2113338557 cites W1997882689 @default.
- W2113338557 cites W1999306817 @default.
- W2113338557 cites W2007572995 @default.
- W2113338557 cites W2010747199 @default.
- W2113338557 cites W2023122441 @default.
- W2113338557 cites W2035476608 @default.
- W2113338557 cites W2045271686 @default.
- W2113338557 cites W2065231486 @default.
- W2113338557 cites W2084727637 @default.
- W2113338557 cites W2090322880 @default.
- W2113338557 cites W2093529653 @default.
- W2113338557 cites W2102061396 @default.
- W2113338557 cites W2104373803 @default.
- W2113338557 cites W2104734478 @default.
- W2113338557 cites W2677289244 @default.
- W2113338557 cites W4233979608 @default.
- W2113338557 doi "https://doi.org/10.1145/2612669.2612671" @default.
- W2113338557 hasPublicationYear "2014" @default.
- W2113338557 type Work @default.
- W2113338557 sameAs 2113338557 @default.
- W2113338557 citedByCount "22" @default.
- W2113338557 countsByYear W21133385572014 @default.
- W2113338557 countsByYear W21133385572015 @default.
- W2113338557 countsByYear W21133385572016 @default.
- W2113338557 countsByYear W21133385572017 @default.
- W2113338557 countsByYear W21133385572018 @default.
- W2113338557 countsByYear W21133385572019 @default.
- W2113338557 countsByYear W21133385572021 @default.
- W2113338557 countsByYear W21133385572023 @default.
- W2113338557 crossrefType "proceedings-article" @default.
- W2113338557 hasAuthorship W2113338557A5022838370 @default.
- W2113338557 hasAuthorship W2113338557A5072265294 @default.
- W2113338557 hasAuthorship W2113338557A5076825233 @default.
- W2113338557 hasAuthorship W2113338557A5078588702 @default.
- W2113338557 hasConcept C11413529 @default.
- W2113338557 hasConcept C115903868 @default.
- W2113338557 hasConcept C118615104 @default.
- W2113338557 hasConcept C120373497 @default.
- W2113338557 hasConcept C127162648 @default.
- W2113338557 hasConcept C134306372 @default.
- W2113338557 hasConcept C139352143 @default.
- W2113338557 hasConcept C156891508 @default.
- W2113338557 hasConcept C173608175 @default.
- W2113338557 hasConcept C19768560 @default.
- W2113338557 hasConcept C2524010 @default.
- W2113338557 hasConcept C2778562939 @default.
- W2113338557 hasConcept C2781221856 @default.
- W2113338557 hasConcept C31258907 @default.
- W2113338557 hasConcept C33923547 @default.
- W2113338557 hasConcept C41008148 @default.
- W2113338557 hasConcept C45374587 @default.
- W2113338557 hasConcept C77553402 @default.
- W2113338557 hasConcept C80444323 @default.
- W2113338557 hasConceptScore W2113338557C11413529 @default.
- W2113338557 hasConceptScore W2113338557C115903868 @default.
- W2113338557 hasConceptScore W2113338557C118615104 @default.
- W2113338557 hasConceptScore W2113338557C120373497 @default.
- W2113338557 hasConceptScore W2113338557C127162648 @default.
- W2113338557 hasConceptScore W2113338557C134306372 @default.
- W2113338557 hasConceptScore W2113338557C139352143 @default.
- W2113338557 hasConceptScore W2113338557C156891508 @default.
- W2113338557 hasConceptScore W2113338557C173608175 @default.
- W2113338557 hasConceptScore W2113338557C19768560 @default.
- W2113338557 hasConceptScore W2113338557C2524010 @default.
- W2113338557 hasConceptScore W2113338557C2778562939 @default.
- W2113338557 hasConceptScore W2113338557C2781221856 @default.
- W2113338557 hasConceptScore W2113338557C31258907 @default.
- W2113338557 hasConceptScore W2113338557C33923547 @default.
- W2113338557 hasConceptScore W2113338557C41008148 @default.
- W2113338557 hasConceptScore W2113338557C45374587 @default.
- W2113338557 hasConceptScore W2113338557C77553402 @default.
- W2113338557 hasConceptScore W2113338557C80444323 @default.
- W2113338557 hasFunder F4320306084 @default.
- W2113338557 hasFunder F4320332180 @default.
- W2113338557 hasLocation W21133385571 @default.
- W2113338557 hasOpenAccess W2113338557 @default.
- W2113338557 hasPrimaryLocation W21133385571 @default.
- W2113338557 hasRelatedWork W1488189214 @default.
- W2113338557 hasRelatedWork W168439140 @default.
- W2113338557 hasRelatedWork W1974158449 @default.
- W2113338557 hasRelatedWork W2025285962 @default.
- W2113338557 hasRelatedWork W2034511771 @default.
- W2113338557 hasRelatedWork W2143455557 @default.
- W2113338557 hasRelatedWork W2348761119 @default.
- W2113338557 hasRelatedWork W2615259895 @default.
- W2113338557 hasRelatedWork W4232907588 @default.
- W2113338557 hasRelatedWork W2462936459 @default.
- W2113338557 isParatext "false" @default.