FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W2003138918> ?p ?o ?g. }

• W2003138918 endingPage "424" @default.
• W2003138918 startingPage "409" @default.
• W2003138918 abstract "MapReduce is emerging as a prominent tool for big data processing. Data locality is a key feature in MapReduce that is extensively leveraged in data-intensive cloud systems: it avoids network saturation when processing large amounts of data by co-allocating computation and data storage, particularly for the map phase. However, our studies with Hadoop, a widely used MapReduce implementation, demonstrate that the presence of partitioning skew (Partitioning skew refers to the case when a variation in either the intermediate keys’ frequencies or their distributions or both among different data nodes) causes a huge amount of data transfer during the shuffle phase and leads to significant unfairness on the reduce input among different data nodes. As a result, the applications severe performance degradation due to the long data transfer during the shuffle phase along with the computation skew, particularly in reduce phase. In this paper, we develop a novel algorithm named LEEN for locality-aware and fairness-aware key partitioning in MapReduce. LEEN embraces an asynchronous map and reduce scheme. All buffered intermediate keys are partitioned according to their frequencies and the fairness of the expected data distribution after the shuffle phase. We have integrated LEEN into Hadoop. Our experiments demonstrate that LEEN can efficiently achieve higher locality and reduce the amount of shuffled data. More importantly, LEEN guarantees fair distribution of the reduce inputs. As a result, LEEN achieves a performance improvement of up to 45 % on different workloads." @default.
• W2003138918 created "2016-06-24" @default.
• W2003138918 creator A5003766128 @default.
• W2003138918 creator A5022262922 @default.
• W2003138918 creator A5030429211 @default.
• W2003138918 creator A5039946576 @default.
• W2003138918 creator A5077818565 @default.
• W2003138918 creator A5090305095 @default.
• W2003138918 date "2013-05-25" @default.
• W2003138918 modified "2023-10-10" @default.
• W2003138918 title "Handling partitioning skew in MapReduce using LEEN" @default.
• W2003138918 cites W1571189856 @default.
• W2003138918 cites W1997020216 @default.
• W2003138918 cites W2020302654 @default.
• W2003138918 cites W2039536220 @default.
• W2003138918 cites W2043099794 @default.
• W2003138918 cites W2058394802 @default.
• W2003138918 cites W2063431258 @default.
• W2003138918 cites W2089797934 @default.
• W2003138918 cites W2096092966 @default.
• W2003138918 cites W2096125134 @default.
• W2003138918 cites W2096893233 @default.
• W2003138918 cites W2100830825 @default.
• W2003138918 cites W2102130607 @default.
• W2003138918 cites W2104644701 @default.
• W2003138918 cites W2104927295 @default.
• W2003138918 cites W2105160174 @default.
• W2003138918 cites W2117151385 @default.
• W2003138918 cites W2117466692 @default.
• W2003138918 cites W2119565742 @default.
• W2003138918 cites W2120755171 @default.
• W2003138918 cites W2121762798 @default.
• W2003138918 cites W2129817042 @default.
• W2003138918 cites W2132110701 @default.
• W2003138918 cites W2140509629 @default.
• W2003138918 cites W2141267666 @default.
• W2003138918 cites W2148497813 @default.
• W2003138918 cites W2157099238 @default.
• W2003138918 cites W2165769837 @default.
• W2003138918 cites W2166860697 @default.
• W2003138918 cites W2173213060 @default.
• W2003138918 doi "https://doi.org/10.1007/s12083-013-0213-7" @default.
• W2003138918 hasPublicationYear "2013" @default.
• W2003138918 type Work @default.
• W2003138918 sameAs 2003138918 @default.
• W2003138918 citedByCount "37" @default.
• W2003138918 countsByYear W20031389182014 @default.
• W2003138918 countsByYear W20031389182015 @default.
• W2003138918 countsByYear W20031389182016 @default.
• W2003138918 countsByYear W20031389182017 @default.
• W2003138918 countsByYear W20031389182018 @default.
• W2003138918 countsByYear W20031389182019 @default.
• W2003138918 countsByYear W20031389182020 @default.
• W2003138918 countsByYear W20031389182021 @default.
• W2003138918 countsByYear W20031389182022 @default.
• W2003138918 crossrefType "journal-article" @default.
• W2003138918 hasAuthorship W2003138918A5003766128 @default.
• W2003138918 hasAuthorship W2003138918A5022262922 @default.
• W2003138918 hasAuthorship W2003138918A5030429211 @default.
• W2003138918 hasAuthorship W2003138918A5039946576 @default.
• W2003138918 hasAuthorship W2003138918A5077818565 @default.
• W2003138918 hasAuthorship W2003138918A5090305095 @default.
• W2003138918 hasBestOaLocation W20031389182 @default.
• W2003138918 hasConcept C111919701 @default.
• W2003138918 hasConcept C11413529 @default.
• W2003138918 hasConcept C120314980 @default.
• W2003138918 hasConcept C124101348 @default.
• W2003138918 hasConcept C138885662 @default.
• W2003138918 hasConcept C173608175 @default.
• W2003138918 hasConcept C2779808786 @default.
• W2003138918 hasConcept C41008148 @default.
• W2003138918 hasConcept C41895202 @default.
• W2003138918 hasConcept C43711488 @default.
• W2003138918 hasConcept C45374587 @default.
• W2003138918 hasConcept C75684735 @default.
• W2003138918 hasConcept C76155785 @default.
• W2003138918 hasConcept C79974875 @default.
• W2003138918 hasConceptScore W2003138918C111919701 @default.
• W2003138918 hasConceptScore W2003138918C11413529 @default.
• W2003138918 hasConceptScore W2003138918C120314980 @default.
• W2003138918 hasConceptScore W2003138918C124101348 @default.
• W2003138918 hasConceptScore W2003138918C138885662 @default.
• W2003138918 hasConceptScore W2003138918C173608175 @default.
• W2003138918 hasConceptScore W2003138918C2779808786 @default.
• W2003138918 hasConceptScore W2003138918C41008148 @default.
• W2003138918 hasConceptScore W2003138918C41895202 @default.
• W2003138918 hasConceptScore W2003138918C43711488 @default.
• W2003138918 hasConceptScore W2003138918C45374587 @default.
• W2003138918 hasConceptScore W2003138918C75684735 @default.
• W2003138918 hasConceptScore W2003138918C76155785 @default.
• W2003138918 hasConceptScore W2003138918C79974875 @default.
• W2003138918 hasIssue "4" @default.
• W2003138918 hasLocation W20031389181 @default.
• W2003138918 hasLocation W20031389182 @default.
• W2003138918 hasLocation W20031389183 @default.
• W2003138918 hasOpenAccess W2003138918 @default.
• W2003138918 hasPrimaryLocation W20031389181 @default.
• W2003138918 hasRelatedWork W2497432351 @default.

• next