Matches in SemOpenAlex for { <https://semopenalex.org/work/W2750871773> ?p ?o ?g. }
- W2750871773 endingPage "1261" @default.
- W2750871773 startingPage "1250" @default.
- W2750871773 abstract "To execute distributed joins in parallel on compute clusters, systems partition and exchange data records between workers. With large datasets, workers spend a considerable amount of time transferring data over the network. When compute clusters are shared among multiple applications, workers must compete for network bandwidth with other applications. These variances in the available network bandwidth lead to network skew , which causes straggling workers to prolong the join completion time. We describe SquirrelJoin , a distributed join processing technique that uses lazy partitioning to adapt to transient network skew in clusters. Workers maintain in-memory lazy partitions to withhold a subset of records, i.e. not sending them immediately to other workers for processing. Lazy partitions are then assigned dynamically to other workers based on network conditions: each worker takes periodic throughput measurements to estimate its completion time, and lazy partitions are allocated as to minimise the join completion time. We implement SquirrelJoin as part of the Apache Flink distributed dataflow framework and show that, under transient network contention in a shared compute cluster, SquirrelJoin speeds up join completion times by up to 2.9× with only a small, fixed overhead." @default.
- W2750871773 created "2017-09-15" @default.
- W2750871773 creator A5017128852 @default.
- W2750871773 creator A5049824486 @default.
- W2750871773 creator A5078842469 @default.
- W2750871773 date "2017-08-01" @default.
- W2750871773 modified "2023-10-16" @default.
- W2750871773 title "SquirrelJoin" @default.
- W2750871773 cites W1497089183 @default.
- W2750871773 cites W1976511505 @default.
- W2750871773 cites W1993226606 @default.
- W2750871773 cites W1995953849 @default.
- W2750871773 cites W2004618474 @default.
- W2750871773 cites W2023478510 @default.
- W2750871773 cites W2037027334 @default.
- W2750871773 cites W2038412523 @default.
- W2750871773 cites W2043099794 @default.
- W2750871773 cites W2062832101 @default.
- W2750871773 cites W2075620950 @default.
- W2750871773 cites W2080427212 @default.
- W2750871773 cites W2090452820 @default.
- W2750871773 cites W2091520147 @default.
- W2750871773 cites W2091765165 @default.
- W2750871773 cites W2099602864 @default.
- W2750871773 cites W2101161250 @default.
- W2750871773 cites W2102294813 @default.
- W2750871773 cites W2105947650 @default.
- W2750871773 cites W2111519186 @default.
- W2750871773 cites W2132510297 @default.
- W2750871773 cites W2137229314 @default.
- W2750871773 cites W2140509629 @default.
- W2750871773 cites W2168595508 @default.
- W2750871773 cites W2203361072 @default.
- W2750871773 cites W2215987640 @default.
- W2750871773 cites W2435648513 @default.
- W2750871773 cites W3162452290 @default.
- W2750871773 cites W4237515752 @default.
- W2750871773 cites W4238675359 @default.
- W2750871773 cites W4241727697 @default.
- W2750871773 cites W4242648275 @default.
- W2750871773 doi "https://doi.org/10.14778/3137628.3137636" @default.
- W2750871773 hasPublicationYear "2017" @default.
- W2750871773 type Work @default.
- W2750871773 sameAs 2750871773 @default.
- W2750871773 citedByCount "24" @default.
- W2750871773 countsByYear W27508717732017 @default.
- W2750871773 countsByYear W27508717732018 @default.
- W2750871773 countsByYear W27508717732019 @default.
- W2750871773 countsByYear W27508717732020 @default.
- W2750871773 countsByYear W27508717732021 @default.
- W2750871773 countsByYear W27508717732022 @default.
- W2750871773 countsByYear W27508717732023 @default.
- W2750871773 crossrefType "journal-article" @default.
- W2750871773 hasAuthorship W2750871773A5017128852 @default.
- W2750871773 hasAuthorship W2750871773A5049824486 @default.
- W2750871773 hasAuthorship W2750871773A5078842469 @default.
- W2750871773 hasConcept C111919701 @default.
- W2750871773 hasConcept C114614502 @default.
- W2750871773 hasConcept C120314980 @default.
- W2750871773 hasConcept C173608175 @default.
- W2750871773 hasConcept C199360897 @default.
- W2750871773 hasConcept C2776124973 @default.
- W2750871773 hasConcept C2776257435 @default.
- W2750871773 hasConcept C2778692605 @default.
- W2750871773 hasConcept C2779960059 @default.
- W2750871773 hasConcept C31258907 @default.
- W2750871773 hasConcept C33923547 @default.
- W2750871773 hasConcept C41008148 @default.
- W2750871773 hasConcept C42812 @default.
- W2750871773 hasConcept C43711488 @default.
- W2750871773 hasConcept C70061542 @default.
- W2750871773 hasConcept C76155785 @default.
- W2750871773 hasConcept C96324660 @default.
- W2750871773 hasConceptScore W2750871773C111919701 @default.
- W2750871773 hasConceptScore W2750871773C114614502 @default.
- W2750871773 hasConceptScore W2750871773C120314980 @default.
- W2750871773 hasConceptScore W2750871773C173608175 @default.
- W2750871773 hasConceptScore W2750871773C199360897 @default.
- W2750871773 hasConceptScore W2750871773C2776124973 @default.
- W2750871773 hasConceptScore W2750871773C2776257435 @default.
- W2750871773 hasConceptScore W2750871773C2778692605 @default.
- W2750871773 hasConceptScore W2750871773C2779960059 @default.
- W2750871773 hasConceptScore W2750871773C31258907 @default.
- W2750871773 hasConceptScore W2750871773C33923547 @default.
- W2750871773 hasConceptScore W2750871773C41008148 @default.
- W2750871773 hasConceptScore W2750871773C42812 @default.
- W2750871773 hasConceptScore W2750871773C43711488 @default.
- W2750871773 hasConceptScore W2750871773C70061542 @default.
- W2750871773 hasConceptScore W2750871773C76155785 @default.
- W2750871773 hasConceptScore W2750871773C96324660 @default.
- W2750871773 hasIssue "11" @default.
- W2750871773 hasLocation W27508717731 @default.
- W2750871773 hasOpenAccess W2750871773 @default.
- W2750871773 hasPrimaryLocation W27508717731 @default.
- W2750871773 hasRelatedWork W1534871385 @default.
- W2750871773 hasRelatedWork W1567446667 @default.
- W2750871773 hasRelatedWork W1608248699 @default.
- W2750871773 hasRelatedWork W2088799466 @default.