Matches in SemOpenAlex for { <https://semopenalex.org/work/W2896903681> ?p ?o ?g. }
- W2896903681 abstract "Linear algebra operations are widely used in scientific computing and machine learning applications. However, it is challenging for scientists and data analysts to run linear algebra at scales beyond a single machine. Traditional approaches either require access to supercomputing clusters, or impose configuration and cluster management challenges. In this paper we show how the disaggregation of storage and compute resources in so-called environments, combined with compute-intensive workload characteristics, can be exploited to achieve elastic scalability and ease of management. We present numpywren, a system for linear algebra built on a serverless architecture. We also introduce LAmbdaPACK, a domain-specific language designed to implement highly parallel linear algebra algorithms in a serverless setting. We show that, for certain linear algebra algorithms such as matrix multiply, singular value decomposition, and Cholesky decomposition, numpywren's performance (completion time) is within 33% of ScaLAPACK, and its compute efficiency (total CPU-hours) is up to 240% better due to elasticity, while providing an easier to use interface and better fault tolerance. At the same time, we show that the inability of serverless runtimes to exploit locality across the cores in a machine fundamentally limits their network efficiency, which limits performance on other algorithms such as QR factorization. This highlights how cloud providers could better support these types of computations through small changes in their infrastructure." @default.
- W2896903681 created "2018-10-26" @default.
- W2896903681 creator A5002781291 @default.
- W2896903681 creator A5012870568 @default.
- W2896903681 creator A5017267579 @default.
- W2896903681 creator A5023577472 @default.
- W2896903681 creator A5035348123 @default.
- W2896903681 creator A5038920548 @default.
- W2896903681 creator A5041920173 @default.
- W2896903681 creator A5082710354 @default.
- W2896903681 date "2018-10-23" @default.
- W2896903681 modified "2023-09-28" @default.
- W2896903681 title "numpywren: serverless linear algebra" @default.
- W2896903681 cites W1487337216 @default.
- W2896903681 cites W1939822385 @default.
- W2896903681 cites W1991300616 @default.
- W2896903681 cites W2012481411 @default.
- W2896903681 cites W2016279572 @default.
- W2896903681 cites W2093529653 @default.
- W2896903681 cites W2100830825 @default.
- W2896903681 cites W2111221242 @default.
- W2896903681 cites W2115743854 @default.
- W2896903681 cites W2117293168 @default.
- W2896903681 cites W2122747952 @default.
- W2896903681 cites W2153657167 @default.
- W2896903681 cites W2153820245 @default.
- W2896903681 cites W2168612748 @default.
- W2896903681 cites W2309679942 @default.
- W2896903681 cites W2417800902 @default.
- W2896903681 cites W2527672088 @default.
- W2896903681 cites W2547190417 @default.
- W2896903681 cites W2577489668 @default.
- W2896903681 cites W2604025065 @default.
- W2896903681 cites W2604805566 @default.
- W2896903681 cites W2739268706 @default.
- W2896903681 cites W2780624097 @default.
- W2896903681 cites W2913535645 @default.
- W2896903681 cites W2951220536 @default.
- W2896903681 cites W2963288913 @default.
- W2896903681 cites W3103849684 @default.
- W2896903681 hasPublicationYear "2018" @default.
- W2896903681 type Work @default.
- W2896903681 sameAs 2896903681 @default.
- W2896903681 citedByCount "21" @default.
- W2896903681 countsByYear W28969036812019 @default.
- W2896903681 countsByYear W28969036812020 @default.
- W2896903681 countsByYear W28969036812021 @default.
- W2896903681 crossrefType "posted-content" @default.
- W2896903681 hasAuthorship W2896903681A5002781291 @default.
- W2896903681 hasAuthorship W2896903681A5012870568 @default.
- W2896903681 hasAuthorship W2896903681A5017267579 @default.
- W2896903681 hasAuthorship W2896903681A5023577472 @default.
- W2896903681 hasAuthorship W2896903681A5035348123 @default.
- W2896903681 hasAuthorship W2896903681A5038920548 @default.
- W2896903681 hasAuthorship W2896903681A5041920173 @default.
- W2896903681 hasAuthorship W2896903681A5082710354 @default.
- W2896903681 hasConcept C111919701 @default.
- W2896903681 hasConcept C121332964 @default.
- W2896903681 hasConcept C123213974 @default.
- W2896903681 hasConcept C134306372 @default.
- W2896903681 hasConcept C138885662 @default.
- W2896903681 hasConcept C139352143 @default.
- W2896903681 hasConcept C158693339 @default.
- W2896903681 hasConcept C163834973 @default.
- W2896903681 hasConcept C173608175 @default.
- W2896903681 hasConcept C2524010 @default.
- W2896903681 hasConcept C2779808786 @default.
- W2896903681 hasConcept C33923547 @default.
- W2896903681 hasConcept C34727166 @default.
- W2896903681 hasConcept C41008148 @default.
- W2896903681 hasConcept C41895202 @default.
- W2896903681 hasConcept C42355184 @default.
- W2896903681 hasConcept C48044578 @default.
- W2896903681 hasConcept C62520636 @default.
- W2896903681 hasConcept C6802819 @default.
- W2896903681 hasConcept C79974875 @default.
- W2896903681 hasConcept C80444323 @default.
- W2896903681 hasConceptScore W2896903681C111919701 @default.
- W2896903681 hasConceptScore W2896903681C121332964 @default.
- W2896903681 hasConceptScore W2896903681C123213974 @default.
- W2896903681 hasConceptScore W2896903681C134306372 @default.
- W2896903681 hasConceptScore W2896903681C138885662 @default.
- W2896903681 hasConceptScore W2896903681C139352143 @default.
- W2896903681 hasConceptScore W2896903681C158693339 @default.
- W2896903681 hasConceptScore W2896903681C163834973 @default.
- W2896903681 hasConceptScore W2896903681C173608175 @default.
- W2896903681 hasConceptScore W2896903681C2524010 @default.
- W2896903681 hasConceptScore W2896903681C2779808786 @default.
- W2896903681 hasConceptScore W2896903681C33923547 @default.
- W2896903681 hasConceptScore W2896903681C34727166 @default.
- W2896903681 hasConceptScore W2896903681C41008148 @default.
- W2896903681 hasConceptScore W2896903681C41895202 @default.
- W2896903681 hasConceptScore W2896903681C42355184 @default.
- W2896903681 hasConceptScore W2896903681C48044578 @default.
- W2896903681 hasConceptScore W2896903681C62520636 @default.
- W2896903681 hasConceptScore W2896903681C6802819 @default.
- W2896903681 hasConceptScore W2896903681C79974875 @default.
- W2896903681 hasConceptScore W2896903681C80444323 @default.
- W2896903681 hasLocation W28969036811 @default.
- W2896903681 hasOpenAccess W2896903681 @default.