Matches in SemOpenAlex for { <https://semopenalex.org/work/W3133938105> ?p ?o ?g. }
Showing items 1 to 88 of
88
with 100 items per page.
- W3133938105 abstract "Load balancing of skewed data in MapReduce systems like Hadoop is a well-studied problem. Many heuristics already exist to improve the load balance of the reducers thereby reducing the overall execution time. In this paper, we propose a lightweight optimization approach for MapReduce systems to minimize the makespan for repetitive tasks involving a typical frequency distribution. Our idea is to analyze the observed frequency distribution for the given task so as to identify an optimal offset parameter c to add in the hash function to minimize makespan. For two different bucketing methods - modulo labeling and consecutive binning - we present efficient algorithms for finding the optimal value of c. Finally, we present simulation results for both bucketing methods. The results vary with the data distribution and the number of reducers, but generally reduce makespan by 20% on average for power-law distributions, Results are confirmed with experiments on well-known real-world data sets." @default.
- W3133938105 created "2021-03-15" @default.
- W3133938105 creator A5009952954 @default.
- W3133938105 creator A5025290203 @default.
- W3133938105 creator A5044129275 @default.
- W3133938105 creator A5060741187 @default.
- W3133938105 date "2020-12-01" @default.
- W3133938105 modified "2023-09-27" @default.
- W3133938105 title "Improved MapReduce Load Balancing through Distribution-Dependent Hash Function Optimization" @default.
- W3133938105 cites W1578007978 @default.
- W3133938105 cites W2014071862 @default.
- W3133938105 cites W2024680396 @default.
- W3133938105 cites W2080131844 @default.
- W3133938105 cites W2104680817 @default.
- W3133938105 cites W2109606373 @default.
- W3133938105 cites W2115682136 @default.
- W3133938105 cites W2120755171 @default.
- W3133938105 cites W2141267666 @default.
- W3133938105 cites W2150206209 @default.
- W3133938105 cites W2173213060 @default.
- W3133938105 cites W2175110005 @default.
- W3133938105 cites W2542459869 @default.
- W3133938105 cites W2950627632 @default.
- W3133938105 cites W3103362336 @default.
- W3133938105 cites W4250212406 @default.
- W3133938105 doi "https://doi.org/10.1109/icpads51040.2020.00012" @default.
- W3133938105 hasPublicationYear "2020" @default.
- W3133938105 type Work @default.
- W3133938105 sameAs 3133938105 @default.
- W3133938105 citedByCount "0" @default.
- W3133938105 crossrefType "proceedings-article" @default.
- W3133938105 hasAuthorship W3133938105A5009952954 @default.
- W3133938105 hasAuthorship W3133938105A5025290203 @default.
- W3133938105 hasAuthorship W3133938105A5044129275 @default.
- W3133938105 hasAuthorship W3133938105A5060741187 @default.
- W3133938105 hasConcept C111919701 @default.
- W3133938105 hasConcept C11413529 @default.
- W3133938105 hasConcept C126255220 @default.
- W3133938105 hasConcept C127705205 @default.
- W3133938105 hasConcept C137836250 @default.
- W3133938105 hasConcept C138959212 @default.
- W3133938105 hasConcept C173608175 @default.
- W3133938105 hasConcept C175291020 @default.
- W3133938105 hasConcept C187691185 @default.
- W3133938105 hasConcept C199360897 @default.
- W3133938105 hasConcept C206729178 @default.
- W3133938105 hasConcept C2524010 @default.
- W3133938105 hasConcept C33923547 @default.
- W3133938105 hasConcept C38652104 @default.
- W3133938105 hasConcept C41008148 @default.
- W3133938105 hasConcept C55416958 @default.
- W3133938105 hasConcept C68387754 @default.
- W3133938105 hasConcept C99138194 @default.
- W3133938105 hasConceptScore W3133938105C111919701 @default.
- W3133938105 hasConceptScore W3133938105C11413529 @default.
- W3133938105 hasConceptScore W3133938105C126255220 @default.
- W3133938105 hasConceptScore W3133938105C127705205 @default.
- W3133938105 hasConceptScore W3133938105C137836250 @default.
- W3133938105 hasConceptScore W3133938105C138959212 @default.
- W3133938105 hasConceptScore W3133938105C173608175 @default.
- W3133938105 hasConceptScore W3133938105C175291020 @default.
- W3133938105 hasConceptScore W3133938105C187691185 @default.
- W3133938105 hasConceptScore W3133938105C199360897 @default.
- W3133938105 hasConceptScore W3133938105C206729178 @default.
- W3133938105 hasConceptScore W3133938105C2524010 @default.
- W3133938105 hasConceptScore W3133938105C33923547 @default.
- W3133938105 hasConceptScore W3133938105C38652104 @default.
- W3133938105 hasConceptScore W3133938105C41008148 @default.
- W3133938105 hasConceptScore W3133938105C55416958 @default.
- W3133938105 hasConceptScore W3133938105C68387754 @default.
- W3133938105 hasConceptScore W3133938105C99138194 @default.
- W3133938105 hasLocation W31339381051 @default.
- W3133938105 hasOpenAccess W3133938105 @default.
- W3133938105 hasPrimaryLocation W31339381051 @default.
- W3133938105 hasRelatedWork W1489675356 @default.
- W3133938105 hasRelatedWork W1531488649 @default.
- W3133938105 hasRelatedWork W2052647560 @default.
- W3133938105 hasRelatedWork W2105346187 @default.
- W3133938105 hasRelatedWork W2111499695 @default.
- W3133938105 hasRelatedWork W2156176624 @default.
- W3133938105 hasRelatedWork W2387380422 @default.
- W3133938105 hasRelatedWork W2546696010 @default.
- W3133938105 hasRelatedWork W4205921932 @default.
- W3133938105 hasRelatedWork W4308087753 @default.
- W3133938105 isParatext "false" @default.
- W3133938105 isRetracted "false" @default.
- W3133938105 magId "3133938105" @default.
- W3133938105 workType "article" @default.