Matches in SemOpenAlex for { <https://semopenalex.org/work/W2059348194> ?p ?o ?g. }
- W2059348194 abstract "MapReduce is by far one of the most successful realizations of large-scale data-intensive cloud computing platforms. MapReduce automatically parallelizes computation by running multiple map and/or reduce tasks over distributed data across multiple machines. Hadoop is an open source implementation of MapReduce. When Hadoop schedules reduce tasks, it neither exploits data locality nor addresses partitioning skew present in some MapReduce applications. This might lead to increased cluster network traffic. In this paper we investigate the problems of data locality and partitioning skew in Hadoop. We propose Center-of-Gravity Reduce Scheduler (CoGRS), a locality-aware skew-aware reduce task scheduler for saving MapReduce network traffic. In an attempt to exploit data locality, CoGRS schedules each reduce task at its center-of-gravity node, which is computed after considering partitioning skew as well. We implemented CoGRS in Hadoop-0.20.2 and tested it on a private cloud as well as on Amazon EC2. As compared to native Hadoop, our results show that CoGRS minimizes off-rack network traffic by averages of 9.6% and 38.6% on our private cloud and on an Amazon EC2 cluster, respectively. This reflects on job execution times and provides an improvement of up to 23.8%." @default.
- W2059348194 created "2016-06-24" @default.
- W2059348194 creator A5001245246 @default.
- W2059348194 creator A5018894377 @default.
- W2059348194 creator A5075667249 @default.
- W2059348194 date "2012-06-01" @default.
- W2059348194 modified "2023-09-25" @default.
- W2059348194 title "Center-of-Gravity Reduce Task Scheduling to Lower MapReduce Network Traffic" @default.
- W2059348194 cites W2022678927 @default.
- W2059348194 cites W2037072488 @default.
- W2059348194 cites W2058047606 @default.
- W2059348194 cites W2089797934 @default.
- W2059348194 cites W2096125134 @default.
- W2059348194 cites W2100830825 @default.
- W2059348194 cites W2103886725 @default.
- W2059348194 cites W2104644701 @default.
- W2059348194 cites W2109569477 @default.
- W2059348194 cites W2117466692 @default.
- W2059348194 cites W2120755171 @default.
- W2059348194 cites W2121382795 @default.
- W2059348194 cites W2129817042 @default.
- W2059348194 cites W2141267666 @default.
- W2059348194 cites W2155072926 @default.
- W2059348194 cites W2157099238 @default.
- W2059348194 cites W4239670432 @default.
- W2059348194 doi "https://doi.org/10.1109/cloud.2012.92" @default.
- W2059348194 hasPublicationYear "2012" @default.
- W2059348194 type Work @default.
- W2059348194 sameAs 2059348194 @default.
- W2059348194 citedByCount "66" @default.
- W2059348194 countsByYear W20593481942013 @default.
- W2059348194 countsByYear W20593481942014 @default.
- W2059348194 countsByYear W20593481942015 @default.
- W2059348194 countsByYear W20593481942016 @default.
- W2059348194 countsByYear W20593481942017 @default.
- W2059348194 countsByYear W20593481942018 @default.
- W2059348194 countsByYear W20593481942019 @default.
- W2059348194 countsByYear W20593481942020 @default.
- W2059348194 countsByYear W20593481942021 @default.
- W2059348194 countsByYear W20593481942022 @default.
- W2059348194 crossrefType "proceedings-article" @default.
- W2059348194 hasAuthorship W2059348194A5001245246 @default.
- W2059348194 hasAuthorship W2059348194A5018894377 @default.
- W2059348194 hasAuthorship W2059348194A5075667249 @default.
- W2059348194 hasConcept C111919701 @default.
- W2059348194 hasConcept C11413529 @default.
- W2059348194 hasConcept C120314980 @default.
- W2059348194 hasConcept C138885662 @default.
- W2059348194 hasConcept C153740404 @default.
- W2059348194 hasConcept C162324750 @default.
- W2059348194 hasConcept C165696696 @default.
- W2059348194 hasConcept C173608175 @default.
- W2059348194 hasConcept C206729178 @default.
- W2059348194 hasConcept C21547014 @default.
- W2059348194 hasConcept C2779808786 @default.
- W2059348194 hasConcept C38652104 @default.
- W2059348194 hasConcept C41008148 @default.
- W2059348194 hasConcept C41895202 @default.
- W2059348194 hasConcept C43711488 @default.
- W2059348194 hasConcept C45374587 @default.
- W2059348194 hasConcept C75684735 @default.
- W2059348194 hasConcept C76155785 @default.
- W2059348194 hasConcept C79974875 @default.
- W2059348194 hasConcept C93996380 @default.
- W2059348194 hasConceptScore W2059348194C111919701 @default.
- W2059348194 hasConceptScore W2059348194C11413529 @default.
- W2059348194 hasConceptScore W2059348194C120314980 @default.
- W2059348194 hasConceptScore W2059348194C138885662 @default.
- W2059348194 hasConceptScore W2059348194C153740404 @default.
- W2059348194 hasConceptScore W2059348194C162324750 @default.
- W2059348194 hasConceptScore W2059348194C165696696 @default.
- W2059348194 hasConceptScore W2059348194C173608175 @default.
- W2059348194 hasConceptScore W2059348194C206729178 @default.
- W2059348194 hasConceptScore W2059348194C21547014 @default.
- W2059348194 hasConceptScore W2059348194C2779808786 @default.
- W2059348194 hasConceptScore W2059348194C38652104 @default.
- W2059348194 hasConceptScore W2059348194C41008148 @default.
- W2059348194 hasConceptScore W2059348194C41895202 @default.
- W2059348194 hasConceptScore W2059348194C43711488 @default.
- W2059348194 hasConceptScore W2059348194C45374587 @default.
- W2059348194 hasConceptScore W2059348194C75684735 @default.
- W2059348194 hasConceptScore W2059348194C76155785 @default.
- W2059348194 hasConceptScore W2059348194C79974875 @default.
- W2059348194 hasConceptScore W2059348194C93996380 @default.
- W2059348194 hasLocation W20593481941 @default.
- W2059348194 hasOpenAccess W2059348194 @default.
- W2059348194 hasPrimaryLocation W20593481941 @default.
- W2059348194 hasRelatedWork W1509211761 @default.
- W2059348194 hasRelatedWork W2363648756 @default.
- W2059348194 hasRelatedWork W2755998243 @default.
- W2059348194 hasRelatedWork W2900041924 @default.
- W2059348194 hasRelatedWork W3042203097 @default.
- W2059348194 hasRelatedWork W3087648018 @default.
- W2059348194 hasRelatedWork W3088181361 @default.
- W2059348194 hasRelatedWork W3114501693 @default.
- W2059348194 hasRelatedWork W3134318636 @default.
- W2059348194 hasRelatedWork W4382897111 @default.
- W2059348194 isParatext "false" @default.
- W2059348194 isRetracted "false" @default.
- W2059348194 magId "2059348194" @default.