Matches in SemOpenAlex for { <https://semopenalex.org/work/W4251459357> ?p ?o ?g. }
- W4251459357 endingPage "109" @default.
- W4251459357 startingPage "98" @default.
- W4251459357 abstract "Cluster computing applications like MapReduce and Dryad transfer massive amounts of data between their computation stages. These transfers can have a significant impact on job performance, accounting for more than 50% of job completion times. Despite this impact, there has been relatively little work on optimizing the performance of these data transfers, with networking researchers traditionally focusing on per-flow traffic management. We address this limitation by proposing a global management architecture and a set of algorithms that (1) improve the transfer times of common communication patterns, such as broadcast and shuffle, and (2) allow scheduling policies at the transfer level, such as prioritizing a transfer over other transfers. Using a prototype implementation, we show that our solution improves broadcast completion times by up to 4.5X compared to the status quo in Hadoop. We also show that transfer-level scheduling can reduce the completion time of high-priority transfers by 1.7X." @default.
- W4251459357 created "2022-05-12" @default.
- W4251459357 creator A5005554337 @default.
- W4251459357 creator A5013180923 @default.
- W4251459357 creator A5028043903 @default.
- W4251459357 creator A5041920173 @default.
- W4251459357 creator A5049812527 @default.
- W4251459357 date "2011-08-15" @default.
- W4251459357 modified "2023-10-04" @default.
- W4251459357 title "Managing data transfers in computer clusters with orchestra" @default.
- W4251459357 cites W1511814458 @default.
- W4251459357 cites W2022678927 @default.
- W4251459357 cites W2047083855 @default.
- W4251459357 cites W2096125134 @default.
- W4251459357 cites W2099283075 @default.
- W4251459357 cites W2100830825 @default.
- W4251459357 cites W2108675021 @default.
- W4251459357 cites W2118862682 @default.
- W4251459357 cites W2120900812 @default.
- W4251459357 cites W2126210439 @default.
- W4251459357 cites W2132212948 @default.
- W4251459357 cites W2133581580 @default.
- W4251459357 cites W2157614013 @default.
- W4251459357 cites W2163404313 @default.
- W4251459357 cites W2163764145 @default.
- W4251459357 cites W2164284397 @default.
- W4251459357 cites W2170616854 @default.
- W4251459357 cites W4240981274 @default.
- W4251459357 cites W4242418714 @default.
- W4251459357 cites W4245764069 @default.
- W4251459357 cites W4246354968 @default.
- W4251459357 cites W4247842874 @default.
- W4251459357 cites W4256524787 @default.
- W4251459357 doi "https://doi.org/10.1145/2043164.2018448" @default.
- W4251459357 hasPublicationYear "2011" @default.
- W4251459357 type Work @default.
- W4251459357 citedByCount "186" @default.
- W4251459357 countsByYear W42514593572012 @default.
- W4251459357 countsByYear W42514593572013 @default.
- W4251459357 countsByYear W42514593572014 @default.
- W4251459357 countsByYear W42514593572015 @default.
- W4251459357 countsByYear W42514593572016 @default.
- W4251459357 countsByYear W42514593572017 @default.
- W4251459357 countsByYear W42514593572018 @default.
- W4251459357 countsByYear W42514593572019 @default.
- W4251459357 countsByYear W42514593572020 @default.
- W4251459357 countsByYear W42514593572021 @default.
- W4251459357 countsByYear W42514593572022 @default.
- W4251459357 countsByYear W42514593572023 @default.
- W4251459357 crossrefType "journal-article" @default.
- W4251459357 hasAuthorship W4251459357A5005554337 @default.
- W4251459357 hasAuthorship W4251459357A5013180923 @default.
- W4251459357 hasAuthorship W4251459357A5028043903 @default.
- W4251459357 hasAuthorship W4251459357A5041920173 @default.
- W4251459357 hasAuthorship W4251459357A5049812527 @default.
- W4251459357 hasConcept C11413529 @default.
- W4251459357 hasConcept C120314980 @default.
- W4251459357 hasConcept C123657996 @default.
- W4251459357 hasConcept C142362112 @default.
- W4251459357 hasConcept C153349607 @default.
- W4251459357 hasConcept C162324750 @default.
- W4251459357 hasConcept C173608175 @default.
- W4251459357 hasConcept C206729178 @default.
- W4251459357 hasConcept C21547014 @default.
- W4251459357 hasConcept C2776175482 @default.
- W4251459357 hasConcept C2776748549 @default.
- W4251459357 hasConcept C31258907 @default.
- W4251459357 hasConcept C34447519 @default.
- W4251459357 hasConcept C41008148 @default.
- W4251459357 hasConcept C45374587 @default.
- W4251459357 hasConcept C557945733 @default.
- W4251459357 hasConceptScore W4251459357C11413529 @default.
- W4251459357 hasConceptScore W4251459357C120314980 @default.
- W4251459357 hasConceptScore W4251459357C123657996 @default.
- W4251459357 hasConceptScore W4251459357C142362112 @default.
- W4251459357 hasConceptScore W4251459357C153349607 @default.
- W4251459357 hasConceptScore W4251459357C162324750 @default.
- W4251459357 hasConceptScore W4251459357C173608175 @default.
- W4251459357 hasConceptScore W4251459357C206729178 @default.
- W4251459357 hasConceptScore W4251459357C21547014 @default.
- W4251459357 hasConceptScore W4251459357C2776175482 @default.
- W4251459357 hasConceptScore W4251459357C2776748549 @default.
- W4251459357 hasConceptScore W4251459357C31258907 @default.
- W4251459357 hasConceptScore W4251459357C34447519 @default.
- W4251459357 hasConceptScore W4251459357C41008148 @default.
- W4251459357 hasConceptScore W4251459357C45374587 @default.
- W4251459357 hasConceptScore W4251459357C557945733 @default.
- W4251459357 hasIssue "4" @default.
- W4251459357 hasLocation W42514593571 @default.
- W4251459357 hasOpenAccess W4251459357 @default.
- W4251459357 hasPrimaryLocation W42514593571 @default.
- W4251459357 hasRelatedWork W1882733036 @default.
- W4251459357 hasRelatedWork W1992741870 @default.
- W4251459357 hasRelatedWork W2030997710 @default.
- W4251459357 hasRelatedWork W2109998134 @default.
- W4251459357 hasRelatedWork W2160425906 @default.
- W4251459357 hasRelatedWork W2363683157 @default.
- W4251459357 hasRelatedWork W2364074001 @default.