Matches in SemOpenAlex for { <https://semopenalex.org/work/W2950640995> ?p ?o ?g. }
Showing items 1 to 98 of
98
with 100 items per page.
- W2950640995 abstract "Key-based workload partitioning is a common strategy used in parallel stream processing engines, enabling effective key-value tuple distribution over worker threads in a logical operator. While randomized hashing on the keys is capable of balancing the workload for key-based partitioning when the keys generally follow a static distribution, it is likely to generate poor balancing performance when workload variance occurs on the incoming data stream. This paper presents a new key-based workload partitioning framework, with practical algorithms to support dynamic workload assignment for stateful operators. The framework combines hash-based and explicit key-based routing strategies for workload distribution, which specifies the destination worker threads for a handful of keys and assigns the other keys with the hashing function. When short-term distribution fluctuations occur to the incoming data stream, the system adaptively updates the routing table containing the chosen keys, in order to rebalance the workload with minimal migration overhead within the stateful operator. We formulate the rebalance operation as an optimization problem, with multiple objectives on minimizing state migration costs, controlling the size of the routing table and breaking workload imbalance among worker threads. Despite of the NP-hardness nature behind the optimization formulation, we carefully investigate and justify the heuristics behind key (re)routing and state migration, to facilitate fast response to workload variance with ignorable cost to the normal processing in the distributed system. Empirical studies on synthetic data and real-world stream applications validate the usefulness of our proposals and prove the huge advantage of our approaches over state-of-the-art solutions in the literature." @default.
- W2950640995 created "2019-06-27" @default.
- W2950640995 creator A5001295386 @default.
- W2950640995 creator A5016673919 @default.
- W2950640995 creator A5016717153 @default.
- W2950640995 creator A5051378198 @default.
- W2950640995 creator A5077960933 @default.
- W2950640995 creator A5083967189 @default.
- W2950640995 date "2016-10-17" @default.
- W2950640995 modified "2023-10-14" @default.
- W2950640995 title "Parallel Stream Processing Against Workload Skewness and Variance" @default.
- W2950640995 cites W1497089183 @default.
- W2950640995 cites W1517320208 @default.
- W2950640995 cites W1520750340 @default.
- W2950640995 cites W1579114683 @default.
- W2950640995 cites W1884959966 @default.
- W2950640995 cites W1968999661 @default.
- W2950640995 cites W1976821017 @default.
- W2950640995 cites W1997020216 @default.
- W2950640995 cites W2008503861 @default.
- W2950640995 cites W2008888174 @default.
- W2950640995 cites W2012671474 @default.
- W2950640995 cites W2020765652 @default.
- W2950640995 cites W2023478510 @default.
- W2950640995 cites W2037027334 @default.
- W2950640995 cites W2038840358 @default.
- W2950640995 cites W2060540987 @default.
- W2950640995 cites W2071965227 @default.
- W2950640995 cites W2115503987 @default.
- W2950640995 cites W2125716662 @default.
- W2950640995 cites W2140509629 @default.
- W2950640995 cites W2140955554 @default.
- W2950640995 cites W2146875569 @default.
- W2950640995 cites W2158460713 @default.
- W2950640995 cites W2162747054 @default.
- W2950640995 cites W2165769837 @default.
- W2950640995 cites W2271870283 @default.
- W2950640995 cites W2277471751 @default.
- W2950640995 cites W2913854892 @default.
- W2950640995 cites W2951273397 @default.
- W2950640995 cites W2963580420 @default.
- W2950640995 cites W3104218773 @default.
- W2950640995 doi "https://doi.org/10.48550/arxiv.1610.05121" @default.
- W2950640995 hasPublicationYear "2016" @default.
- W2950640995 type Work @default.
- W2950640995 sameAs 2950640995 @default.
- W2950640995 citedByCount "0" @default.
- W2950640995 crossrefType "posted-content" @default.
- W2950640995 hasAuthorship W2950640995A5001295386 @default.
- W2950640995 hasAuthorship W2950640995A5016673919 @default.
- W2950640995 hasAuthorship W2950640995A5016717153 @default.
- W2950640995 hasAuthorship W2950640995A5051378198 @default.
- W2950640995 hasAuthorship W2950640995A5077960933 @default.
- W2950640995 hasAuthorship W2950640995A5083967189 @default.
- W2950640995 hasBestOaLocation W29506409951 @default.
- W2950640995 hasConcept C111919701 @default.
- W2950640995 hasConcept C120314980 @default.
- W2950640995 hasConcept C138959212 @default.
- W2950640995 hasConcept C158379750 @default.
- W2950640995 hasConcept C187691185 @default.
- W2950640995 hasConcept C22927095 @default.
- W2950640995 hasConcept C2524010 @default.
- W2950640995 hasConcept C26517878 @default.
- W2950640995 hasConcept C2778476105 @default.
- W2950640995 hasConcept C31258907 @default.
- W2950640995 hasConcept C33923547 @default.
- W2950640995 hasConcept C41008148 @default.
- W2950640995 hasConcept C74172769 @default.
- W2950640995 hasConceptScore W2950640995C111919701 @default.
- W2950640995 hasConceptScore W2950640995C120314980 @default.
- W2950640995 hasConceptScore W2950640995C138959212 @default.
- W2950640995 hasConceptScore W2950640995C158379750 @default.
- W2950640995 hasConceptScore W2950640995C187691185 @default.
- W2950640995 hasConceptScore W2950640995C22927095 @default.
- W2950640995 hasConceptScore W2950640995C2524010 @default.
- W2950640995 hasConceptScore W2950640995C26517878 @default.
- W2950640995 hasConceptScore W2950640995C2778476105 @default.
- W2950640995 hasConceptScore W2950640995C31258907 @default.
- W2950640995 hasConceptScore W2950640995C33923547 @default.
- W2950640995 hasConceptScore W2950640995C41008148 @default.
- W2950640995 hasConceptScore W2950640995C74172769 @default.
- W2950640995 hasLocation W29506409951 @default.
- W2950640995 hasOpenAccess W2950640995 @default.
- W2950640995 hasPrimaryLocation W29506409951 @default.
- W2950640995 hasRelatedWork W1514383694 @default.
- W2950640995 hasRelatedWork W2014759467 @default.
- W2950640995 hasRelatedWork W2150101281 @default.
- W2950640995 hasRelatedWork W2157860049 @default.
- W2950640995 hasRelatedWork W2380023786 @default.
- W2950640995 hasRelatedWork W2385899138 @default.
- W2950640995 hasRelatedWork W2392884863 @default.
- W2950640995 hasRelatedWork W2429304581 @default.
- W2950640995 hasRelatedWork W2621362874 @default.
- W2950640995 hasRelatedWork W3013420515 @default.
- W2950640995 isParatext "false" @default.
- W2950640995 isRetracted "false" @default.
- W2950640995 magId "2950640995" @default.
- W2950640995 workType "article" @default.